Apr 11 15:14:36 user devstack@n-api.service[61164]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 11 15:14:36 user devstack@n-api.service[61164]: *** Starting uWSGI 2.0.20-debian (64bit) on [Tue Apr 11 15:14:36 2023] *** Apr 11 15:14:36 user devstack@n-api.service[61164]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 11 15:14:36 user devstack@n-api.service[61164]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 11 15:14:36 user devstack@n-api.service[61164]: nodename: user Apr 11 15:14:36 user devstack@n-api.service[61164]: machine: x86_64 Apr 11 15:14:36 user devstack@n-api.service[61164]: clock source: unix Apr 11 15:14:36 user devstack@n-api.service[61164]: pcre jit disabled Apr 11 15:14:36 user devstack@n-api.service[61164]: detected number of CPU cores: 12 Apr 11 15:14:36 user devstack@n-api.service[61164]: current working directory: / Apr 11 15:14:36 user devstack@n-api.service[61164]: detected binary path: /usr/bin/uwsgi-core Apr 11 15:14:36 user devstack@n-api.service[61164]: your processes number limit is 63638 Apr 11 15:14:36 user devstack@n-api.service[61164]: your memory page size is 4096 bytes Apr 11 15:14:36 user devstack@n-api.service[61164]: detected max file descriptor number: 2048 Apr 11 15:14:36 user devstack@n-api.service[61164]: lock engine: pthread robust mutexes Apr 11 15:14:36 user devstack@n-api.service[61164]: thunder lock: enabled Apr 11 15:14:36 user devstack@n-api.service[61164]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 11 15:14:36 user devstack@n-api.service[61164]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 11 15:14:36 user devstack@n-api.service[61164]: Python main interpreter initialized at 0x5595a75fa990 Apr 11 15:14:36 user devstack@n-api.service[61164]: python threads support enabled Apr 11 15:14:36 user devstack@n-api.service[61164]: your server socket listen backlog is limited to 100 connections Apr 11 15:14:36 user devstack@n-api.service[61164]: your mercy for graceful operations on workers is 90 seconds Apr 11 15:14:36 user devstack@n-api.service[61164]: mapped 537436 bytes (524 KB) for 3 cores Apr 11 15:14:36 user devstack@n-api.service[61164]: *** Operational MODE: preforking *** Apr 11 15:14:36 user devstack@n-api.service[61164]: *** uWSGI is running in multiple interpreter mode *** Apr 11 15:14:36 user devstack@n-api.service[61164]: spawned uWSGI master process (pid: 61164) Apr 11 15:14:36 user devstack@n-api.service[61164]: spawned uWSGI worker 1 (pid: 61165, cores: 1) Apr 11 15:14:36 user devstack@n-api.service[61164]: spawned uWSGI worker 2 (pid: 61166, cores: 1) Apr 11 15:14:36 user devstack@n-api.service[61164]: spawned uWSGI worker 3 (pid: 61167, cores: 1) Apr 11 15:14:36 user devstack@n-api.service[61164]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 11 15:14:36 user devstack@n-api.service[61167]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 11 15:14:36 user devstack@n-api.service[61165]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 11 15:14:36 user devstack@n-api.service[61166]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 11 15:14:40 user devstack@n-api.service[61165]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 11 15:14:40 user devstack@n-api.service[61167]: live_migration_uri is deprecated for removal in favor of two other options that Apr 11 15:14:40 user devstack@n-api.service[61167]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 11 15:14:40 user devstack@n-api.service[61167]: and ``live_migration_inbound_addr`` respectively. Apr 11 15:14:40 user devstack@n-api.service[61167]: ). Its value may be silently ignored in the future. Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 11 15:14:40 user devstack@n-api.service[61165]: live_migration_uri is deprecated for removal in favor of two other options that Apr 11 15:14:40 user devstack@n-api.service[61165]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 11 15:14:40 user devstack@n-api.service[61165]: and ``live_migration_inbound_addr`` respectively. Apr 11 15:14:40 user devstack@n-api.service[61165]: ). Its value may be silently ignored in the future. Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 11 15:14:40 user devstack@n-api.service[61166]: live_migration_uri is deprecated for removal in favor of two other options that Apr 11 15:14:40 user devstack@n-api.service[61166]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 11 15:14:40 user devstack@n-api.service[61166]: and ``live_migration_inbound_addr`` respectively. Apr 11 15:14:40 user devstack@n-api.service[61166]: ). Its value may be silently ignored in the future. Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61167) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61165) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61166) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 11 15:14:40 user devstack@n-api.service[61167]: INFO dbcounter [None req-e7c74f66-c794-4c6c-b8d6-d5c82d661f5e None None] Registered counter for database nova_api Apr 11 15:14:40 user devstack@n-api.service[61165]: INFO dbcounter [None req-aef4e4ef-35b5-4f50-9006-26d4973a03c0 None None] Registered counter for database nova_api Apr 11 15:14:40 user devstack@n-api.service[61166]: INFO dbcounter [None req-aff8e5d1-98d7-42b8-9ddb-849a33a7e75f None None] Registered counter for database nova_api Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG oslo_db.sqlalchemy.engines [None req-e7c74f66-c794-4c6c-b8d6-d5c82d661f5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61167) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writer thread running {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG oslo_db.sqlalchemy.engines [None req-aef4e4ef-35b5-4f50-9006-26d4973a03c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61165) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG oslo_db.sqlalchemy.engines [None req-aff8e5d1-98d7-42b8-9ddb-849a33a7e75f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61166) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writer thread running {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writer thread running {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG nova.context [None req-e7c74f66-c794-4c6c-b8d6-d5c82d661f5e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc(cell1) {{(pid=61167) load_cells /opt/stack/nova/nova/context.py:464}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e7c74f66-c794-4c6c-b8d6-d5c82d661f5e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e7c74f66-c794-4c6c-b8d6-d5c82d661f5e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e7c74f66-c794-4c6c-b8d6-d5c82d661f5e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e7c74f66-c794-4c6c-b8d6-d5c82d661f5e None None] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e7c74f66-c794-4c6c-b8d6-d5c82d661f5e None None] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e7c74f66-c794-4c6c-b8d6-d5c82d661f5e None None] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG nova.context [None req-aef4e4ef-35b5-4f50-9006-26d4973a03c0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc(cell1) {{(pid=61165) load_cells /opt/stack/nova/nova/context.py:464}} Apr 11 15:14:40 user devstack@n-api.service[61167]: INFO dbcounter [None req-e7c74f66-c794-4c6c-b8d6-d5c82d661f5e None None] Registered counter for database nova_cell0 Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-aef4e4ef-35b5-4f50-9006-26d4973a03c0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-aef4e4ef-35b5-4f50-9006-26d4973a03c0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:14:40 user devstack@n-api.service[61167]: INFO dbcounter [None req-e7c74f66-c794-4c6c-b8d6-d5c82d661f5e None None] Registered counter for database nova_cell1 Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-aef4e4ef-35b5-4f50-9006-26d4973a03c0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-aef4e4ef-35b5-4f50-9006-26d4973a03c0 None None] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-aef4e4ef-35b5-4f50-9006-26d4973a03c0 None None] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG oslo_db.sqlalchemy.engines [None req-e7c74f66-c794-4c6c-b8d6-d5c82d661f5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61167) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-aef4e4ef-35b5-4f50-9006-26d4973a03c0 None None] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG oslo_db.sqlalchemy.engines [None req-e7c74f66-c794-4c6c-b8d6-d5c82d661f5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61167) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG nova.context [None req-aff8e5d1-98d7-42b8-9ddb-849a33a7e75f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc(cell1) {{(pid=61166) load_cells /opt/stack/nova/nova/context.py:464}} Apr 11 15:14:40 user devstack@n-api.service[61165]: INFO dbcounter [None req-aef4e4ef-35b5-4f50-9006-26d4973a03c0 None None] Registered counter for database nova_cell0 Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writer thread running {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-aff8e5d1-98d7-42b8-9ddb-849a33a7e75f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:14:40 user devstack@n-api.service[61165]: INFO dbcounter [None req-aef4e4ef-35b5-4f50-9006-26d4973a03c0 None None] Registered counter for database nova_cell1 Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-aff8e5d1-98d7-42b8-9ddb-849a33a7e75f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writer thread running {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-aff8e5d1-98d7-42b8-9ddb-849a33a7e75f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-aff8e5d1-98d7-42b8-9ddb-849a33a7e75f None None] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-aff8e5d1-98d7-42b8-9ddb-849a33a7e75f None None] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-aff8e5d1-98d7-42b8-9ddb-849a33a7e75f None None] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:14:40 user devstack@n-api.service[61166]: INFO dbcounter [None req-aff8e5d1-98d7-42b8-9ddb-849a33a7e75f None None] Registered counter for database nova_cell0 Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG oslo_db.sqlalchemy.engines [None req-aef4e4ef-35b5-4f50-9006-26d4973a03c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61165) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 15:14:40 user devstack@n-api.service[61166]: INFO dbcounter [None req-aff8e5d1-98d7-42b8-9ddb-849a33a7e75f None None] Registered counter for database nova_cell1 Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writer thread running {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG oslo_db.sqlalchemy.engines [None req-aef4e4ef-35b5-4f50-9006-26d4973a03c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61165) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG oslo_db.sqlalchemy.engines [None req-aff8e5d1-98d7-42b8-9ddb-849a33a7e75f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61166) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writer thread running {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG oslo_db.sqlalchemy.engines [None req-aff8e5d1-98d7-42b8-9ddb-849a33a7e75f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61166) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 15:14:40 user devstack@n-api.service[61167]: INFO dbcounter [None req-e7c74f66-c794-4c6c-b8d6-d5c82d661f5e None None] Registered counter for database nova_cell0 Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writer thread running {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG oslo_db.sqlalchemy.engines [None req-e7c74f66-c794-4c6c-b8d6-d5c82d661f5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61167) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 15:14:40 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writer thread running {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 15:14:40 user devstack@n-api.service[61165]: INFO dbcounter [None req-aef4e4ef-35b5-4f50-9006-26d4973a03c0 None None] Registered counter for database nova_cell0 Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writer thread running {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG oslo_db.sqlalchemy.engines [None req-aef4e4ef-35b5-4f50-9006-26d4973a03c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61165) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 15:14:40 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writer thread running {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 15:14:40 user devstack@n-api.service[61166]: INFO dbcounter [None req-aff8e5d1-98d7-42b8-9ddb-849a33a7e75f None None] Registered counter for database nova_cell0 Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG oslo_db.sqlalchemy.engines [None req-aff8e5d1-98d7-42b8-9ddb-849a33a7e75f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61166) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 15:14:40 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writer thread running {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 15:14:40 user devstack@n-api.service[61167]: WARNING keystonemiddleware.auth_token [None req-e7c74f66-c794-4c6c-b8d6-d5c82d661f5e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 15:14:40 user devstack@n-api.service[61167]: WARNING keystonemiddleware.auth_token [None req-e7c74f66-c794-4c6c-b8d6-d5c82d661f5e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 15:14:40 user devstack@n-api.service[61165]: WARNING keystonemiddleware.auth_token [None req-aef4e4ef-35b5-4f50-9006-26d4973a03c0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 15:14:40 user devstack@n-api.service[61165]: WARNING keystonemiddleware.auth_token [None req-aef4e4ef-35b5-4f50-9006-26d4973a03c0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 15:14:41 user devstack@n-api.service[61166]: WARNING keystonemiddleware.auth_token [None req-aff8e5d1-98d7-42b8-9ddb-849a33a7e75f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 15:14:41 user devstack@n-api.service[61166]: WARNING keystonemiddleware.auth_token [None req-aff8e5d1-98d7-42b8-9ddb-849a33a7e75f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 15:14:41 user devstack@n-api.service[61167]: WARNING keystonemiddleware.auth_token [None req-e7c74f66-c794-4c6c-b8d6-d5c82d661f5e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 15:14:41 user devstack@n-api.service[61167]: WARNING keystonemiddleware.auth_token [None req-e7c74f66-c794-4c6c-b8d6-d5c82d661f5e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 15:14:41 user devstack@n-api.service[61167]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5595a75fa990 pid: 61167 (default app) Apr 11 15:14:41 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-e7c74f66-c794-4c6c-b8d6-d5c82d661f5e None None] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:14:41 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-e7c74f66-c794-4c6c-b8d6-d5c82d661f5e None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001503 Apr 11 15:14:41 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Tue Apr 11 15:14:41 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:14:41 user devstack@n-api.service[61165]: WARNING keystonemiddleware.auth_token [None req-aef4e4ef-35b5-4f50-9006-26d4973a03c0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 15:14:41 user devstack@n-api.service[61165]: WARNING keystonemiddleware.auth_token [None req-aef4e4ef-35b5-4f50-9006-26d4973a03c0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 15:14:41 user devstack@n-api.service[61165]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5595a75fa990 pid: 61165 (default app) Apr 11 15:14:41 user devstack@n-api.service[61166]: WARNING keystonemiddleware.auth_token [None req-aff8e5d1-98d7-42b8-9ddb-849a33a7e75f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 15:14:41 user devstack@n-api.service[61166]: WARNING keystonemiddleware.auth_token [None req-aff8e5d1-98d7-42b8-9ddb-849a33a7e75f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 15:14:41 user devstack@n-api.service[61166]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5595a75fa990 pid: 61166 (default app) Apr 11 15:16:48 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-e7c74f66-c794-4c6c-b8d6-d5c82d661f5e None None] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:16:48 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-e7c74f66-c794-4c6c-b8d6-d5c82d661f5e None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001430 Apr 11 15:16:48 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 15:16:48 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:16:48 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=3 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:16:48 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=3 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:16:48 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=3 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:16:48 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=3 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:16:49 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-a81d54ac-3961-4196-bc17-a7a2d19e75b5 admin admin] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:16:49 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-a81d54ac-3961-4196-bc17-a7a2d19e75b5 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.417181 Apr 11 15:16:49 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Tue Apr 11 15:16:48 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:16:51 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-aff8e5d1-98d7-42b8-9ddb-849a33a7e75f None None] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:16:51 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-aff8e5d1-98d7-42b8-9ddb-849a33a7e75f None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.003465 Apr 11 15:16:51 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 15:16:51 2023] GET /compute/v2.1 => generated 387 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:16:51 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=3 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:16:51 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=3 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:16:51 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=3 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:16:51 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:16:51 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-46c103cd-bfd2-457d-ab55-4691d6f765a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "vcpus": 1, "os-flavor-access:is_public": true, "ram": 256, "swap": 0}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:16:51 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-46c103cd-bfd2-457d-ab55-4691d6f765a5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.333859 Apr 11 15:16:51 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 15:16:51 2023] POST /compute/v2.1/flavors => generated 405 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 15:16:51 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-d60db168-bd4a-4b0c-9314-c13e02cd6aa0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:16:51 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-d60db168-bd4a-4b0c-9314-c13e02cd6aa0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047222 Apr 11 15:16:51 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 15:16:51 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:16:53 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-aff8e5d1-98d7-42b8-9ddb-849a33a7e75f None None] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:16:53 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-aff8e5d1-98d7-42b8-9ddb-849a33a7e75f None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001586 Apr 11 15:16:53 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 15:16:53 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:16:53 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-f53b99af-a990-46d1-9fba-7d0656caf623 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 5, "ram": 512, "name": "ds512M"}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:16:53 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-f53b99af-a990-46d1-9fba-7d0656caf623 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.061095 Apr 11 15:16:53 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 15:16:53 2023] POST /compute/v2.1/flavors => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 15:16:53 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-10d2399e-a68d-42bd-875f-4bc6cf0dcd98 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:16:53 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-10d2399e-a68d-42bd-875f-4bc6cf0dcd98 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037841 Apr 11 15:16:53 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 15:16:53 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:16:55 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-aff8e5d1-98d7-42b8-9ddb-849a33a7e75f None None] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:16:55 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-aff8e5d1-98d7-42b8-9ddb-849a33a7e75f None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002146 Apr 11 15:16:55 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 15:16:55 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:16:55 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-65e73b55-f0ed-4a66-931a-c9e84ecf0871 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "swap": 0, "ram": 1024, "id": "d2"}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:16:55 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-65e73b55-f0ed-4a66-931a-c9e84ecf0871 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.072191 Apr 11 15:16:55 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 15:16:55 2023] POST /compute/v2.1/flavors => generated 402 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 15:16:55 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-633e0065-ca58-478e-9d50-22af76556e59 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:16:55 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-633e0065-ca58-478e-9d50-22af76556e59 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027989 Apr 11 15:16:55 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 15:16:55 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:16:57 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-aff8e5d1-98d7-42b8-9ddb-849a33a7e75f None None] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:16:57 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-aff8e5d1-98d7-42b8-9ddb-849a33a7e75f None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001517 Apr 11 15:16:57 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 15:16:57 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:16:57 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-7f6b907c-eb14-42fe-a340-1fa01b884282 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds2G", "os-flavor-access:is_public": true, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "vcpus": 2, "rxtx_factor": 1.0, "ram": 2048}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:16:57 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-7f6b907c-eb14-42fe-a340-1fa01b884282 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.059592 Apr 11 15:16:57 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 15:16:57 2023] POST /compute/v2.1/flavors => generated 402 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 15:16:57 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-2850d3d4-f57a-47b4-9e69-3a81157ca3f0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:16:57 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-2850d3d4-f57a-47b4-9e69-3a81157ca3f0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051284 Apr 11 15:16:57 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 15:16:57 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:16:59 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-aff8e5d1-98d7-42b8-9ddb-849a33a7e75f None None] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:16:59 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-aff8e5d1-98d7-42b8-9ddb-849a33a7e75f None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001533 Apr 11 15:16:59 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 15:16:59 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:16:59 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-a859c180-39bd-43f5-afa3-9519c7ee2e1d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "name": "ds4G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "rxtx_factor": 1.0, "vcpus": 4, "swap": 0}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:16:59 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-a859c180-39bd-43f5-afa3-9519c7ee2e1d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.079706 Apr 11 15:16:59 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 15:16:59 2023] POST /compute/v2.1/flavors => generated 402 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 15:16:59 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-92e1845d-71bf-437c-a3ea-75c94a3c1c37 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:16:59 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-92e1845d-71bf-437c-a3ea-75c94a3c1c37 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027196 Apr 11 15:16:59 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 15:16:59 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:17:01 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-aff8e5d1-98d7-42b8-9ddb-849a33a7e75f None None] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:17:01 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-aff8e5d1-98d7-42b8-9ddb-849a33a7e75f None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001488 Apr 11 15:17:01 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 15:17:01 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:17:01 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-46562c7c-7edb-47b2-b8cc-01d0e7dc4c1a admin admin] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:17:01 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-46562c7c-7edb-47b2-b8cc-01d0e7dc4c1a admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.112660 Apr 11 15:17:01 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Tue Apr 11 15:17:01 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:17:03 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-92e1845d-71bf-437c-a3ea-75c94a3c1c37 admin admin] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:17:03 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-92e1845d-71bf-437c-a3ea-75c94a3c1c37 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001758 Apr 11 15:17:03 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 15:17:03 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:17:03 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=3 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:17:03 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=3 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:17:03 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=3 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:17:03 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=3 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:17:03 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-3ff606f7-ef75-45dd-9957-e2fd24d1c505 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "id": "1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:17:03 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-3ff606f7-ef75-45dd-9957-e2fd24d1c505 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.406324 Apr 11 15:17:03 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 15:17:03 2023] POST /compute/v2.1/flavors => generated 400 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 15:17:03 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-823d454d-ff23-495f-b801-ff89d4f9333f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:17:04 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-823d454d-ff23-495f-b801-ff89d4f9333f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041662 Apr 11 15:17:04 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 15:17:03 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:17:05 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-92e1845d-71bf-437c-a3ea-75c94a3c1c37 admin admin] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:17:05 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-92e1845d-71bf-437c-a3ea-75c94a3c1c37 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002322 Apr 11 15:17:05 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 15:17:05 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:17:05 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-772a2214-fea0-4c6c-a31e-54b023317d40 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "name": "m1.small", "vcpus": 1, "disk": 20, "os-flavor-access:is_public": true, "id": "2", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:17:06 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-772a2214-fea0-4c6c-a31e-54b023317d40 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.068471 Apr 11 15:17:06 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 15:17:05 2023] POST /compute/v2.1/flavors => generated 403 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 15:17:06 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-a8603d0a-b5b9-4e12-af46-7b8eaafd0c75 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:17:06 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-a8603d0a-b5b9-4e12-af46-7b8eaafd0c75 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026041 Apr 11 15:17:06 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 15:17:06 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:17:07 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-92e1845d-71bf-437c-a3ea-75c94a3c1c37 admin admin] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:17:07 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-92e1845d-71bf-437c-a3ea-75c94a3c1c37 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001533 Apr 11 15:17:07 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 15:17:07 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:17:07 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-360b9f76-1d79-4168-aef9-c095e737d00d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "id": "3", "swap": 0, "name": "m1.medium"}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:17:07 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-360b9f76-1d79-4168-aef9-c095e737d00d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.059297 Apr 11 15:17:07 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 15:17:07 2023] POST /compute/v2.1/flavors => generated 404 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 15:17:08 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-a0dcca08-9f9c-48ef-8349-04564132e742 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:17:08 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-a0dcca08-9f9c-48ef-8349-04564132e742 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023165 Apr 11 15:17:08 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 15:17:08 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:17:09 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-92e1845d-71bf-437c-a3ea-75c94a3c1c37 admin admin] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:17:09 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-92e1845d-71bf-437c-a3ea-75c94a3c1c37 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001633 Apr 11 15:17:09 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 15:17:09 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:17:09 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-22c358f8-6165-40c3-98f2-ceed7e9c1de2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 8192, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.large", "id": "4", "vcpus": 4}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:17:09 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-22c358f8-6165-40c3-98f2-ceed7e9c1de2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.059381 Apr 11 15:17:09 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 15:17:09 2023] POST /compute/v2.1/flavors => generated 403 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 15:17:09 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-56a1c84f-8602-451f-afb1-ed24606d0538 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:17:09 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-56a1c84f-8602-451f-afb1-ed24606d0538 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023432 Apr 11 15:17:09 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 15:17:09 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:17:11 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-92e1845d-71bf-437c-a3ea-75c94a3c1c37 admin admin] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:17:11 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-92e1845d-71bf-437c-a3ea-75c94a3c1c37 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001609 Apr 11 15:17:11 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 15:17:11 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:17:11 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-5bff5bda-eb42-48b4-bb7b-48acd17e2b41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "id": "5", "disk": 160, "ram": 16384}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:17:11 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-5bff5bda-eb42-48b4-bb7b-48acd17e2b41 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.060120 Apr 11 15:17:11 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 15:17:11 2023] POST /compute/v2.1/flavors => generated 406 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 15:17:12 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-adfec9d7-fc40-46c0-9e8e-7336d5931b3b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:17:12 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-adfec9d7-fc40-46c0-9e8e-7336d5931b3b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023429 Apr 11 15:17:12 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 15:17:11 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:17:44 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-92e1845d-71bf-437c-a3ea-75c94a3c1c37 admin admin] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:17:44 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-92e1845d-71bf-437c-a3ea-75c94a3c1c37 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002390 Apr 11 15:17:44 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 11 15:17:44 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:17:44 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:17:44 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-135772de-1dae-489a-9706-bfbd5ad9ff5d admin admin] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:17:44 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-135772de-1dae-489a-9706-bfbd5ad9ff5d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:17:44 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-135772de-1dae-489a-9706-bfbd5ad9ff5d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:17:44 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-135772de-1dae-489a-9706-bfbd5ad9ff5d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:17:44 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-135772de-1dae-489a-9706-bfbd5ad9ff5d admin admin] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:17:44 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-135772de-1dae-489a-9706-bfbd5ad9ff5d admin admin] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:17:44 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-135772de-1dae-489a-9706-bfbd5ad9ff5d admin admin] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:17:44 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-135772de-1dae-489a-9706-bfbd5ad9ff5d admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.095212 Apr 11 15:17:44 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Tue Apr 11 15:17:44 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 15:18:15 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-adfec9d7-fc40-46c0-9e8e-7336d5931b3b admin admin] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:18:15 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-adfec9d7-fc40-46c0-9e8e-7336d5931b3b admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001695 Apr 11 15:18:15 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 11 15:18:15 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:18:15 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:18:15 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-582a1dab-d103-4d15-9851-af1c0fce54f4 admin admin] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:18:15 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-582a1dab-d103-4d15-9851-af1c0fce54f4 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.063761 Apr 11 15:18:15 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Tue Apr 11 15:18:15 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:18:20 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-135772de-1dae-489a-9706-bfbd5ad9ff5d admin admin] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:18:20 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-135772de-1dae-489a-9706-bfbd5ad9ff5d admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.003552 Apr 11 15:18:20 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 11 15:18:20 2023] GET /compute/v2.1 => generated 387 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:18:20 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:18:20 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-99bde906-65fc-4e67-9d8e-f646f216843e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 128, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "name": "m1.nano", "id": "42", "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:18:20 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-99bde906-65fc-4e67-9d8e-f646f216843e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.068484 Apr 11 15:18:20 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Tue Apr 11 15:18:20 2023] POST /compute/v2.1/flavors => generated 403 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 15:18:20 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-380df8a8-0319-4136-9979-a16c94471488 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:18:20 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-380df8a8-0319-4136-9979-a16c94471488 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032735 Apr 11 15:18:20 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Tue Apr 11 15:18:20 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:18:24 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-135772de-1dae-489a-9706-bfbd5ad9ff5d admin admin] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:18:24 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-135772de-1dae-489a-9706-bfbd5ad9ff5d admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001951 Apr 11 15:18:24 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 11 15:18:24 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:18:24 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-f0a7ee48-dcfa-4d4b-a933-b17a1a95a6aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 192, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "84"}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:18:24 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-f0a7ee48-dcfa-4d4b-a933-b17a1a95a6aa admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075751 Apr 11 15:18:24 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Tue Apr 11 15:18:24 2023] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 15:18:24 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-a46e115a-356f-45e7-b6d7-6a4417c7668e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:18:24 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-a46e115a-356f-45e7-b6d7-6a4417c7668e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023688 Apr 11 15:18:24 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Tue Apr 11 15:18:24 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:20:36 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:20:36 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:20:36 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:20:36 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-cd8fa1ea-ec18-4728-8d3c-acc08acef628 tempest-VolumesGetTestJSON-1803745102 tempest-VolumesGetTestJSON-1803745102-project-member] Action: 'create', calling method: .version_select at 0x7f4c2fd8d630>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-886180597", "metadata": {"Type": "work"}}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:20:38 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-cd8fa1ea-ec18-4728-8d3c-acc08acef628 tempest-VolumesGetTestJSON-1803745102 tempest-VolumesGetTestJSON-1803745102-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.108975 Apr 11 15:20:38 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 11 15:20:36 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 2112 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 11 15:20:38 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:20:38 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-f9d67240-e027-468f-9380-8ad8a7fb2710 tempest-VolumesGetTestJSON-1803745102 tempest-VolumesGetTestJSON-1803745102-project-member] Calling method '.version_select at 0x7f4c2fd99b40>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:20:38 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-f9d67240-e027-468f-9380-8ad8a7fb2710 tempest-VolumesGetTestJSON-1803745102 tempest-VolumesGetTestJSON-1803745102-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5f16a850-d619-4311-b3c0-06ac0d920ea7" status: 200 len: 352 microversion: 2.1 time: 0.362408 Apr 11 15:20:38 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 17/47] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 15:20:38 2023] GET /compute/v2.1/os-volumes/5f16a850-d619-4311-b3c0-06ac0d920ea7 => generated 352 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:20:39 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:20:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-5bb7a9e5-d7bc-4199-92f7-56d474e76ba3 tempest-VolumesGetTestJSON-1803745102 tempest-VolumesGetTestJSON-1803745102-project-member] Calling method '.version_select at 0x7f4c2fea32e0>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:20:40 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-5bb7a9e5-d7bc-4199-92f7-56d474e76ba3 tempest-VolumesGetTestJSON-1803745102 tempest-VolumesGetTestJSON-1803745102-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5f16a850-d619-4311-b3c0-06ac0d920ea7" status: 200 len: 353 microversion: 2.1 time: 0.325029 Apr 11 15:20:40 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 16/48] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 15:20:39 2023] GET /compute/v2.1/os-volumes/5f16a850-d619-4311-b3c0-06ac0d920ea7 => generated 353 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:20:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-5b382c9a-3e86-4ca7-8823-38fac4f0bd6b tempest-VolumesGetTestJSON-1803745102 tempest-VolumesGetTestJSON-1803745102-project-member] Calling method '.version_select at 0x7f4c2fc1c700>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:20:40 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-5b382c9a-3e86-4ca7-8823-38fac4f0bd6b tempest-VolumesGetTestJSON-1803745102 tempest-VolumesGetTestJSON-1803745102-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5f16a850-d619-4311-b3c0-06ac0d920ea7" status: 200 len: 353 microversion: 2.1 time: 0.084263 Apr 11 15:20:40 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 15:20:40 2023] GET /compute/v2.1/os-volumes/5f16a850-d619-4311-b3c0-06ac0d920ea7 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:20:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-a158744d-3dd8-433b-87aa-c9d60371c6fd tempest-VolumesGetTestJSON-1803745102 tempest-VolumesGetTestJSON-1803745102-project-member] Calling method '.version_select at 0x7f4c2fc1f760>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:20:40 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-a158744d-3dd8-433b-87aa-c9d60371c6fd tempest-VolumesGetTestJSON-1803745102 tempest-VolumesGetTestJSON-1803745102-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/5f16a850-d619-4311-b3c0-06ac0d920ea7" status: 202 len: 0 microversion: 2.1 time: 0.093337 Apr 11 15:20:40 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 15:20:40 2023] DELETE /compute/v2.1/os-volumes/5f16a850-d619-4311-b3c0-06ac0d920ea7 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:20:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-e93aed5d-ba3b-4fdd-87ed-f2835057b0bd tempest-VolumesGetTestJSON-1803745102 tempest-VolumesGetTestJSON-1803745102-project-member] Calling method '.version_select at 0x7f4c2fc13250>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:20:40 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-e93aed5d-ba3b-4fdd-87ed-f2835057b0bd tempest-VolumesGetTestJSON-1803745102 tempest-VolumesGetTestJSON-1803745102-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5f16a850-d619-4311-b3c0-06ac0d920ea7" status: 200 len: 352 microversion: 2.1 time: 0.059420 Apr 11 15:20:40 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 17/51] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 15:20:40 2023] GET /compute/v2.1/os-volumes/5f16a850-d619-4311-b3c0-06ac0d920ea7 => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 15:20:41 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-7c714183-f65f-4115-bdd2-42a37b7c53b3 tempest-VolumesGetTestJSON-1803745102 tempest-VolumesGetTestJSON-1803745102-project-member] Calling method '.version_select at 0x7f4c2fc1cdc0>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:20:41 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-7c714183-f65f-4115-bdd2-42a37b7c53b3 tempest-VolumesGetTestJSON-1803745102 tempest-VolumesGetTestJSON-1803745102-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5f16a850-d619-4311-b3c0-06ac0d920ea7" status: 200 len: 352 microversion: 2.1 time: 0.082587 Apr 11 15:20:41 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 17/52] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 15:20:41 2023] GET /compute/v2.1/os-volumes/5f16a850-d619-4311-b3c0-06ac0d920ea7 => generated 352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:20:42 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-84f7a88a-9f81-4e3c-a67c-6c99a05c4704 tempest-VolumesGetTestJSON-1803745102 tempest-VolumesGetTestJSON-1803745102-project-member] Calling method '.version_select at 0x7f4c2fc1fe20>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:20:42 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-84f7a88a-9f81-4e3c-a67c-6c99a05c4704 tempest-VolumesGetTestJSON-1803745102 tempest-VolumesGetTestJSON-1803745102-project-member] HTTP exception thrown: Volume 5f16a850-d619-4311-b3c0-06ac0d920ea7 could not be found. Apr 11 15:20:42 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-84f7a88a-9f81-4e3c-a67c-6c99a05c4704 tempest-VolumesGetTestJSON-1803745102 tempest-VolumesGetTestJSON-1803745102-project-member] Request method failure captured: Apr 11 15:20:42 user devstack@n-api.service[61167]: request: GET /compute/v2.1/os-volumes/5f16a850-d619-4311-b3c0-06ac0d920ea7 HTTP/1.1 Apr 11 15:20:42 user devstack@n-api.service[61167]: Accept: application/json Apr 11 15:20:42 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 15:20:42 user devstack@n-api.service[61167]: Connection: close Apr 11 15:20:42 user devstack@n-api.service[61167]: Content-Length: 0 Apr 11 15:20:42 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 15:20:42 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 15:20:42 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 15:20:42 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 15:20:42 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNXrE9mhWcr2IoPJn0znJJZyam16zZ_rtmwv1MK0cm1HthNy7RyV4KTdWT7MxBFw1AilSgY-eGIiNhB2ziScrFyGQ1S6BMzP0JlPvrm0-A7EI1PSQ2ln4tJUajXKwJkPaRuKPMDYaMIFsLaqkyDhxkMnMySDXRxDjBG_v1DB8p10GMpU Apr 11 15:20:42 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 15:20:42 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 15:20:42 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 15:20:42 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 15:20:42 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 15:20:42 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 15:20:42 user devstack@n-api.service[61167]: X-Project-Id: 4403cdc60a87431d9fcb14c772429f6e Apr 11 15:20:42 user devstack@n-api.service[61167]: X-Project-Name: tempest-VolumesGetTestJSON-1803745102 Apr 11 15:20:42 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 15:20:42 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 15:20:42 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4403cdc60a87431d9fcb14c772429f6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4403cdc60a87431d9fcb14c772429f6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4403cdc60a87431d9fcb14c772429f6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:20:42 user devstack@n-api.service[61167]: X-Tenant: tempest-VolumesGetTestJSON-1803745102 Apr 11 15:20:42 user devstack@n-api.service[61167]: X-Tenant-Id: 4403cdc60a87431d9fcb14c772429f6e Apr 11 15:20:42 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-VolumesGetTestJSON-1803745102 Apr 11 15:20:42 user devstack@n-api.service[61167]: X-User: tempest-VolumesGetTestJSON-1803745102-project-member Apr 11 15:20:42 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 15:20:42 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 15:20:42 user devstack@n-api.service[61167]: X-User-Id: 08db2f05cef24420bfdbcd42338087fa Apr 11 15:20:42 user devstack@n-api.service[61167]: X-User-Name: tempest-VolumesGetTestJSON-1803745102-project-member Apr 11 15:20:42 user devstack@n-api.service[61167]: method: Apr 11 15:20:42 user devstack@n-api.service[61167]: exception: Volume 5f16a850-d619-4311-b3c0-06ac0d920ea7 could not be found. Apr 11 15:20:42 user devstack@n-api.service[61167]: action_args: {'id': '5f16a850-d619-4311-b3c0-06ac0d920ea7'} Apr 11 15:20:42 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5f16a850-d619-4311-b3c0-06ac0d920ea7 could not be found. (HTTP 404) (Request-ID: req-8f5b5b94-1b5a-41a9-a139-8e974bf70251) Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5f16a850-d619-4311-b3c0-06ac0d920ea7 could not be found. Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5f16a850-d619-4311-b3c0-06ac0d920ea7 could not be found. Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5f16a850-d619-4311-b3c0-06ac0d920ea7 could not be found. Apr 11 15:20:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:20:42 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-84f7a88a-9f81-4e3c-a67c-6c99a05c4704 tempest-VolumesGetTestJSON-1803745102 tempest-VolumesGetTestJSON-1803745102-project-member] Returning 404 to user: Volume 5f16a850-d619-4311-b3c0-06ac0d920ea7 could not be found. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:20:42 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-84f7a88a-9f81-4e3c-a67c-6c99a05c4704 tempest-VolumesGetTestJSON-1803745102 tempest-VolumesGetTestJSON-1803745102-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5f16a850-d619-4311-b3c0-06ac0d920ea7" status: 404 len: 109 microversion: 2.1 time: 0.036354 Apr 11 15:20:42 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 19/53] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 15:20:42 2023] GET /compute/v2.1/os-volumes/5f16a850-d619-4311-b3c0-06ac0d920ea7 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:20:46 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-0e38bbbb-ddc0-484a-95bb-70eb1dddd5a6 tempest-VolumesNegativeTest-1336867649 tempest-VolumesNegativeTest-1336867649-project-member] Action: 'create', calling method: .version_select at 0x7f4c2fc13880>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-952909762", "metadata": {"Type": "work"}}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:20:46 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-0e38bbbb-ddc0-484a-95bb-70eb1dddd5a6 tempest-VolumesNegativeTest-1336867649 tempest-VolumesNegativeTest-1336867649-project-member] Request method failure captured: Apr 11 15:20:46 user devstack@n-api.service[61165]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 11 15:20:46 user devstack@n-api.service[61165]: Accept: application/json Apr 11 15:20:46 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 15:20:46 user devstack@n-api.service[61165]: Connection: close Apr 11 15:20:46 user devstack@n-api.service[61165]: Content-Length: 121 Apr 11 15:20:46 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 15:20:46 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 15:20:46 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 15:20:46 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNXrNzWw2L8EGl6-UTTFtQvQRHBBL0r5i0qkssMxgdMSzu_PxFjKEA_FqyOu8yEdzSbrlOCpXI_RPXJsNztpD5hWwdO9smmLHqQtILaJEdsqIgQtqGzp-nNlfV5YBoPfq9Su2ZOrCdagt5VJBbAMKIBCPOj15u3FJsimXpQ6kPbOte9M Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Project-Id: 856a23ee4ea941a0805b10ed816e9b25 Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Project-Name: tempest-VolumesNegativeTest-1336867649 Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/856a23ee4ea941a0805b10ed816e9b25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/856a23ee4ea941a0805b10ed816e9b25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/856a23ee4ea941a0805b10ed816e9b25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Tenant: tempest-VolumesNegativeTest-1336867649 Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Tenant-Id: 856a23ee4ea941a0805b10ed816e9b25 Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-VolumesNegativeTest-1336867649 Apr 11 15:20:46 user devstack@n-api.service[61165]: X-User: tempest-VolumesNegativeTest-1336867649-project-member Apr 11 15:20:46 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 15:20:46 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 15:20:46 user devstack@n-api.service[61165]: X-User-Id: 4136e5948dfb45728cc832b8b5a9a075 Apr 11 15:20:46 user devstack@n-api.service[61165]: X-User-Name: tempest-VolumesNegativeTest-1336867649-project-member Apr 11 15:20:46 user devstack@n-api.service[61165]: Apr 11 15:20:46 user devstack@n-api.service[61165]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-952909762", "metadata": {"Type": "work"}}} Apr 11 15:20:46 user devstack@n-api.service[61165]: method: Apr 11 15:20:46 user devstack@n-api.service[61165]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 11 15:20:46 user devstack@n-api.service[61165]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-952909762', 'metadata': {'Type': 'work'}}}} Apr 11 15:20:46 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise error Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi '#$%' Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-0e38bbbb-ddc0-484a-95bb-70eb1dddd5a6 tempest-VolumesNegativeTest-1336867649 tempest-VolumesNegativeTest-1336867649-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:20:46 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-0e38bbbb-ddc0-484a-95bb-70eb1dddd5a6 tempest-VolumesNegativeTest-1336867649 tempest-VolumesNegativeTest-1336867649-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.144981 Apr 11 15:20:46 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 18/54] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 11 15:20:45 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 148 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 15:20:46 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-36d57d40-23e9-4970-ba5f-a37e49e3edfd tempest-VolumesNegativeTest-1336867649 tempest-VolumesNegativeTest-1336867649-project-member] Action: 'create', calling method: .version_select at 0x7f4c2fc1d3f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-423573445", "metadata": {"Type": "work"}}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:20:46 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-36d57d40-23e9-4970-ba5f-a37e49e3edfd tempest-VolumesNegativeTest-1336867649 tempest-VolumesNegativeTest-1336867649-project-member] Request method failure captured: Apr 11 15:20:46 user devstack@n-api.service[61166]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 11 15:20:46 user devstack@n-api.service[61166]: Accept: application/json Apr 11 15:20:46 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 15:20:46 user devstack@n-api.service[61166]: Connection: close Apr 11 15:20:46 user devstack@n-api.service[61166]: Content-Length: 119 Apr 11 15:20:46 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 15:20:46 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 15:20:46 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 15:20:46 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 15:20:46 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNXrNzWw2L8EGl6-UTTFtQvQRHBBL0r5i0qkssMxgdMSzu_PxFjKEA_FqyOu8yEdzSbrlOCpXI_RPXJsNztpD5hWwdO9smmLHqQtILaJEdsqIgQtqGzp-nNlfV5YBoPfq9Su2ZOrCdagt5VJBbAMKIBCPOj15u3FJsimXpQ6kPbOte9M Apr 11 15:20:46 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 15:20:46 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 15:20:46 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 15:20:46 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 15:20:46 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 15:20:46 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 15:20:46 user devstack@n-api.service[61166]: X-Project-Id: 856a23ee4ea941a0805b10ed816e9b25 Apr 11 15:20:46 user devstack@n-api.service[61166]: X-Project-Name: tempest-VolumesNegativeTest-1336867649 Apr 11 15:20:46 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 15:20:46 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 15:20:46 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/856a23ee4ea941a0805b10ed816e9b25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/856a23ee4ea941a0805b10ed816e9b25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/856a23ee4ea941a0805b10ed816e9b25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:20:46 user devstack@n-api.service[61166]: X-Tenant: tempest-VolumesNegativeTest-1336867649 Apr 11 15:20:46 user devstack@n-api.service[61166]: X-Tenant-Id: 856a23ee4ea941a0805b10ed816e9b25 Apr 11 15:20:46 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-VolumesNegativeTest-1336867649 Apr 11 15:20:46 user devstack@n-api.service[61166]: X-User: tempest-VolumesNegativeTest-1336867649-project-member Apr 11 15:20:46 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 15:20:46 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 15:20:46 user devstack@n-api.service[61166]: X-User-Id: 4136e5948dfb45728cc832b8b5a9a075 Apr 11 15:20:46 user devstack@n-api.service[61166]: X-User-Name: tempest-VolumesNegativeTest-1336867649-project-member Apr 11 15:20:46 user devstack@n-api.service[61166]: Apr 11 15:20:46 user devstack@n-api.service[61166]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-423573445", "metadata": {"Type": "work"}}} Apr 11 15:20:46 user devstack@n-api.service[61166]: method: Apr 11 15:20:46 user devstack@n-api.service[61166]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 11 15:20:46 user devstack@n-api.service[61166]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-423573445', 'metadata': {'Type': 'work'}}}} Apr 11 15:20:46 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise error Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi '0' Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-36d57d40-23e9-4970-ba5f-a37e49e3edfd tempest-VolumesNegativeTest-1336867649 tempest-VolumesNegativeTest-1336867649-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:20:46 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-36d57d40-23e9-4970-ba5f-a37e49e3edfd tempest-VolumesNegativeTest-1336867649 tempest-VolumesNegativeTest-1336867649-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015001 Apr 11 15:20:46 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 18/55] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 11 15:20:46 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 15:20:46 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-a61bbc54-d593-4d23-9f11-faff1504c58c tempest-VolumesNegativeTest-1336867649 tempest-VolumesNegativeTest-1336867649-project-member] Action: 'create', calling method: .version_select at 0x7f4c2fc78e50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1335336449", "metadata": {"Type": "work"}}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:20:46 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-a61bbc54-d593-4d23-9f11-faff1504c58c tempest-VolumesNegativeTest-1336867649 tempest-VolumesNegativeTest-1336867649-project-member] Request method failure captured: Apr 11 15:20:46 user devstack@n-api.service[61167]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 11 15:20:46 user devstack@n-api.service[61167]: Accept: application/json Apr 11 15:20:46 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 15:20:46 user devstack@n-api.service[61167]: Connection: close Apr 11 15:20:46 user devstack@n-api.service[61167]: Content-Length: 119 Apr 11 15:20:46 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 15:20:46 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 15:20:46 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 15:20:46 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 15:20:46 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNXrNzWw2L8EGl6-UTTFtQvQRHBBL0r5i0qkssMxgdMSzu_PxFjKEA_FqyOu8yEdzSbrlOCpXI_RPXJsNztpD5hWwdO9smmLHqQtILaJEdsqIgQtqGzp-nNlfV5YBoPfq9Su2ZOrCdagt5VJBbAMKIBCPOj15u3FJsimXpQ6kPbOte9M Apr 11 15:20:46 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 15:20:46 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 15:20:46 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 15:20:46 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 15:20:46 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 15:20:46 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 15:20:46 user devstack@n-api.service[61167]: X-Project-Id: 856a23ee4ea941a0805b10ed816e9b25 Apr 11 15:20:46 user devstack@n-api.service[61167]: X-Project-Name: tempest-VolumesNegativeTest-1336867649 Apr 11 15:20:46 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 15:20:46 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 15:20:46 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/856a23ee4ea941a0805b10ed816e9b25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/856a23ee4ea941a0805b10ed816e9b25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/856a23ee4ea941a0805b10ed816e9b25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:20:46 user devstack@n-api.service[61167]: X-Tenant: tempest-VolumesNegativeTest-1336867649 Apr 11 15:20:46 user devstack@n-api.service[61167]: X-Tenant-Id: 856a23ee4ea941a0805b10ed816e9b25 Apr 11 15:20:46 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-VolumesNegativeTest-1336867649 Apr 11 15:20:46 user devstack@n-api.service[61167]: X-User: tempest-VolumesNegativeTest-1336867649-project-member Apr 11 15:20:46 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 15:20:46 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 15:20:46 user devstack@n-api.service[61167]: X-User-Id: 4136e5948dfb45728cc832b8b5a9a075 Apr 11 15:20:46 user devstack@n-api.service[61167]: X-User-Name: tempest-VolumesNegativeTest-1336867649-project-member Apr 11 15:20:46 user devstack@n-api.service[61167]: Apr 11 15:20:46 user devstack@n-api.service[61167]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1335336449", "metadata": {"Type": "work"}}} Apr 11 15:20:46 user devstack@n-api.service[61167]: method: Apr 11 15:20:46 user devstack@n-api.service[61167]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 11 15:20:46 user devstack@n-api.service[61167]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1335336449', 'metadata': {'Type': 'work'}}}} Apr 11 15:20:46 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise error Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi '' Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 11 15:20:46 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-a61bbc54-d593-4d23-9f11-faff1504c58c tempest-VolumesNegativeTest-1336867649 tempest-VolumesNegativeTest-1336867649-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:20:46 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-a61bbc54-d593-4d23-9f11-faff1504c58c tempest-VolumesNegativeTest-1336867649 tempest-VolumesNegativeTest-1336867649-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009938 Apr 11 15:20:46 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 20/56] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 11 15:20:46 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 11 15:20:46 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-2954c2d8-901a-45d8-ac85-e1da571189e6 tempest-VolumesNegativeTest-1336867649 tempest-VolumesNegativeTest-1336867649-project-member] Calling method '.version_select at 0x7f4c2fc13d90>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:20:46 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-2954c2d8-901a-45d8-ac85-e1da571189e6 tempest-VolumesNegativeTest-1336867649 tempest-VolumesNegativeTest-1336867649-project-member] HTTP exception thrown: Volume tempest-invalid-61103909 could not be found. Apr 11 15:20:46 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-2954c2d8-901a-45d8-ac85-e1da571189e6 tempest-VolumesNegativeTest-1336867649 tempest-VolumesNegativeTest-1336867649-project-member] Request method failure captured: Apr 11 15:20:46 user devstack@n-api.service[61165]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-61103909 HTTP/1.1 Apr 11 15:20:46 user devstack@n-api.service[61165]: Accept: application/json Apr 11 15:20:46 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 15:20:46 user devstack@n-api.service[61165]: Connection: close Apr 11 15:20:46 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 15:20:46 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 15:20:46 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 15:20:46 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 15:20:46 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNXrNzWw2L8EGl6-UTTFtQvQRHBBL0r5i0qkssMxgdMSzu_PxFjKEA_FqyOu8yEdzSbrlOCpXI_RPXJsNztpD5hWwdO9smmLHqQtILaJEdsqIgQtqGzp-nNlfV5YBoPfq9Su2ZOrCdagt5VJBbAMKIBCPOj15u3FJsimXpQ6kPbOte9M Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Project-Id: 856a23ee4ea941a0805b10ed816e9b25 Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Project-Name: tempest-VolumesNegativeTest-1336867649 Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/856a23ee4ea941a0805b10ed816e9b25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/856a23ee4ea941a0805b10ed816e9b25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/856a23ee4ea941a0805b10ed816e9b25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Tenant: tempest-VolumesNegativeTest-1336867649 Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Tenant-Id: 856a23ee4ea941a0805b10ed816e9b25 Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-VolumesNegativeTest-1336867649 Apr 11 15:20:46 user devstack@n-api.service[61165]: X-User: tempest-VolumesNegativeTest-1336867649-project-member Apr 11 15:20:46 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 15:20:46 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 15:20:46 user devstack@n-api.service[61165]: X-User-Id: 4136e5948dfb45728cc832b8b5a9a075 Apr 11 15:20:46 user devstack@n-api.service[61165]: X-User-Name: tempest-VolumesNegativeTest-1336867649-project-member Apr 11 15:20:46 user devstack@n-api.service[61165]: method: Apr 11 15:20:46 user devstack@n-api.service[61165]: exception: Volume tempest-invalid-61103909 could not be found. Apr 11 15:20:46 user devstack@n-api.service[61165]: action_args: {'id': 'tempest-invalid-61103909'} Apr 11 15:20:46 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-61103909 could not be found. (HTTP 404) (Request-ID: req-615c2207-13a6-4002-8b52-09b5be93a0da) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-61103909 could not be found. Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-61103909 could not be found. Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-61103909 could not be found. Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-2954c2d8-901a-45d8-ac85-e1da571189e6 tempest-VolumesNegativeTest-1336867649 tempest-VolumesNegativeTest-1336867649-project-member] Returning 404 to user: Volume tempest-invalid-61103909 could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:20:46 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-2954c2d8-901a-45d8-ac85-e1da571189e6 tempest-VolumesNegativeTest-1336867649 tempest-VolumesNegativeTest-1336867649-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-61103909" status: 404 len: 97 microversion: 2.1 time: 0.043541 Apr 11 15:20:46 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 19/57] 10.0.0.210 () {62 vars in 1289 bytes} [Tue Apr 11 15:20:46 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-61103909 => generated 97 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 11 15:20:46 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-93232768-00cd-46f9-9d5a-c262d704990f tempest-VolumesNegativeTest-1336867649 tempest-VolumesNegativeTest-1336867649-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004163 Apr 11 15:20:46 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 19/58] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Apr 11 15:20:46 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 11 15:20:46 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-67ab9896-b778-4d3b-ba3e-7272e1de4032 tempest-VolumesNegativeTest-1336867649 tempest-VolumesNegativeTest-1336867649-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004891 Apr 11 15:20:46 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 21/59] 10.0.0.210 () {62 vars in 1214 bytes} [Tue Apr 11 15:20:46 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 11 15:20:46 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-ca755e18-d04c-46da-a4f9-af358218537d tempest-VolumesNegativeTest-1336867649 tempest-VolumesNegativeTest-1336867649-project-member] Calling method '.version_select at 0x7f4c307b1870>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:20:46 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-ca755e18-d04c-46da-a4f9-af358218537d tempest-VolumesNegativeTest-1336867649 tempest-VolumesNegativeTest-1336867649-project-member] HTTP exception thrown: Volume b0d86d7b-c87b-45a3-bc9c-97351f8c645d could not be found. Apr 11 15:20:46 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-ca755e18-d04c-46da-a4f9-af358218537d tempest-VolumesNegativeTest-1336867649 tempest-VolumesNegativeTest-1336867649-project-member] Request method failure captured: Apr 11 15:20:46 user devstack@n-api.service[61165]: request: DELETE /compute/v2.1/os-volumes/b0d86d7b-c87b-45a3-bc9c-97351f8c645d HTTP/1.1 Apr 11 15:20:46 user devstack@n-api.service[61165]: Accept: application/json Apr 11 15:20:46 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 15:20:46 user devstack@n-api.service[61165]: Connection: close Apr 11 15:20:46 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 15:20:46 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 15:20:46 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 15:20:46 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 15:20:46 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNXrNzWw2L8EGl6-UTTFtQvQRHBBL0r5i0qkssMxgdMSzu_PxFjKEA_FqyOu8yEdzSbrlOCpXI_RPXJsNztpD5hWwdO9smmLHqQtILaJEdsqIgQtqGzp-nNlfV5YBoPfq9Su2ZOrCdagt5VJBbAMKIBCPOj15u3FJsimXpQ6kPbOte9M Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Project-Id: 856a23ee4ea941a0805b10ed816e9b25 Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Project-Name: tempest-VolumesNegativeTest-1336867649 Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/856a23ee4ea941a0805b10ed816e9b25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/856a23ee4ea941a0805b10ed816e9b25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/856a23ee4ea941a0805b10ed816e9b25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Tenant: tempest-VolumesNegativeTest-1336867649 Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Tenant-Id: 856a23ee4ea941a0805b10ed816e9b25 Apr 11 15:20:46 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-VolumesNegativeTest-1336867649 Apr 11 15:20:46 user devstack@n-api.service[61165]: X-User: tempest-VolumesNegativeTest-1336867649-project-member Apr 11 15:20:46 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 15:20:46 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 15:20:46 user devstack@n-api.service[61165]: X-User-Id: 4136e5948dfb45728cc832b8b5a9a075 Apr 11 15:20:46 user devstack@n-api.service[61165]: X-User-Name: tempest-VolumesNegativeTest-1336867649-project-member Apr 11 15:20:46 user devstack@n-api.service[61165]: method: Apr 11 15:20:46 user devstack@n-api.service[61165]: exception: Volume b0d86d7b-c87b-45a3-bc9c-97351f8c645d could not be found. Apr 11 15:20:46 user devstack@n-api.service[61165]: action_args: {'id': 'b0d86d7b-c87b-45a3-bc9c-97351f8c645d'} Apr 11 15:20:46 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b0d86d7b-c87b-45a3-bc9c-97351f8c645d could not be found. (HTTP 404) (Request-ID: req-f147dfc4-d52b-42b9-90aa-f5c94ce17cb1) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b0d86d7b-c87b-45a3-bc9c-97351f8c645d could not be found. Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b0d86d7b-c87b-45a3-bc9c-97351f8c645d could not be found. Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b0d86d7b-c87b-45a3-bc9c-97351f8c645d could not be found. Apr 11 15:20:46 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-ca755e18-d04c-46da-a4f9-af358218537d tempest-VolumesNegativeTest-1336867649 tempest-VolumesNegativeTest-1336867649-project-member] Returning 404 to user: Volume b0d86d7b-c87b-45a3-bc9c-97351f8c645d could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:20:46 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-ca755e18-d04c-46da-a4f9-af358218537d tempest-VolumesNegativeTest-1336867649 tempest-VolumesNegativeTest-1336867649-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/b0d86d7b-c87b-45a3-bc9c-97351f8c645d" status: 404 len: 109 microversion: 2.1 time: 0.044409 Apr 11 15:20:46 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 20/60] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 15:20:46 2023] DELETE /compute/v2.1/os-volumes/b0d86d7b-c87b-45a3-bc9c-97351f8c645d => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:20:46 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-2ec3c59d-fdc0-46ca-880f-7bc96f8b3004 tempest-VolumesNegativeTest-1336867649 tempest-VolumesNegativeTest-1336867649-project-member] Calling method '.version_select at 0x7f4c2fc1c8b0>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:20:46 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-2ec3c59d-fdc0-46ca-880f-7bc96f8b3004 tempest-VolumesNegativeTest-1336867649 tempest-VolumesNegativeTest-1336867649-project-member] HTTP exception thrown: Volume dd806326-d299-4d74-bead-77fba7510b4c could not be found. Apr 11 15:20:46 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-2ec3c59d-fdc0-46ca-880f-7bc96f8b3004 tempest-VolumesNegativeTest-1336867649 tempest-VolumesNegativeTest-1336867649-project-member] Request method failure captured: Apr 11 15:20:46 user devstack@n-api.service[61166]: request: GET /compute/v2.1/os-volumes/dd806326-d299-4d74-bead-77fba7510b4c HTTP/1.1 Apr 11 15:20:46 user devstack@n-api.service[61166]: Accept: application/json Apr 11 15:20:46 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 15:20:46 user devstack@n-api.service[61166]: Connection: close Apr 11 15:20:46 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 15:20:46 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 15:20:46 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 15:20:46 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 15:20:46 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 15:20:46 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNXrNzWw2L8EGl6-UTTFtQvQRHBBL0r5i0qkssMxgdMSzu_PxFjKEA_FqyOu8yEdzSbrlOCpXI_RPXJsNztpD5hWwdO9smmLHqQtILaJEdsqIgQtqGzp-nNlfV5YBoPfq9Su2ZOrCdagt5VJBbAMKIBCPOj15u3FJsimXpQ6kPbOte9M Apr 11 15:20:46 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 15:20:46 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 15:20:46 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 15:20:46 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 15:20:46 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 15:20:46 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 15:20:46 user devstack@n-api.service[61166]: X-Project-Id: 856a23ee4ea941a0805b10ed816e9b25 Apr 11 15:20:46 user devstack@n-api.service[61166]: X-Project-Name: tempest-VolumesNegativeTest-1336867649 Apr 11 15:20:46 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 15:20:46 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 15:20:46 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/856a23ee4ea941a0805b10ed816e9b25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/856a23ee4ea941a0805b10ed816e9b25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/856a23ee4ea941a0805b10ed816e9b25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:20:46 user devstack@n-api.service[61166]: X-Tenant: tempest-VolumesNegativeTest-1336867649 Apr 11 15:20:46 user devstack@n-api.service[61166]: X-Tenant-Id: 856a23ee4ea941a0805b10ed816e9b25 Apr 11 15:20:46 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-VolumesNegativeTest-1336867649 Apr 11 15:20:46 user devstack@n-api.service[61166]: X-User: tempest-VolumesNegativeTest-1336867649-project-member Apr 11 15:20:46 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 15:20:46 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 15:20:46 user devstack@n-api.service[61166]: X-User-Id: 4136e5948dfb45728cc832b8b5a9a075 Apr 11 15:20:46 user devstack@n-api.service[61166]: X-User-Name: tempest-VolumesNegativeTest-1336867649-project-member Apr 11 15:20:46 user devstack@n-api.service[61166]: method: Apr 11 15:20:46 user devstack@n-api.service[61166]: exception: Volume dd806326-d299-4d74-bead-77fba7510b4c could not be found. Apr 11 15:20:46 user devstack@n-api.service[61166]: action_args: {'id': 'dd806326-d299-4d74-bead-77fba7510b4c'} Apr 11 15:20:46 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dd806326-d299-4d74-bead-77fba7510b4c could not be found. (HTTP 404) (Request-ID: req-2163dfe6-8e3e-4314-8e5a-ec9ec5a2126a) Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dd806326-d299-4d74-bead-77fba7510b4c could not be found. Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dd806326-d299-4d74-bead-77fba7510b4c could not be found. Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dd806326-d299-4d74-bead-77fba7510b4c could not be found. Apr 11 15:20:46 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:20:46 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-2ec3c59d-fdc0-46ca-880f-7bc96f8b3004 tempest-VolumesNegativeTest-1336867649 tempest-VolumesNegativeTest-1336867649-project-member] Returning 404 to user: Volume dd806326-d299-4d74-bead-77fba7510b4c could not be found. {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:20:46 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-2ec3c59d-fdc0-46ca-880f-7bc96f8b3004 tempest-VolumesNegativeTest-1336867649 tempest-VolumesNegativeTest-1336867649-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/dd806326-d299-4d74-bead-77fba7510b4c" status: 404 len: 109 microversion: 2.1 time: 0.064962 Apr 11 15:20:46 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 20/61] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 15:20:46 2023] GET /compute/v2.1/os-volumes/dd806326-d299-4d74-bead-77fba7510b4c => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:20:52 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1804245774", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "networks": [{"uuid": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef"}]}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:20:52 user devstack@n-api.service[61167]: DEBUG nova.network.neutron [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] validate_networks() for [('1cf4cec3-ff08-4320-89e4-aa7e8cf75eef', None, None, None, None, None)] {{(pid=61167) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:20:54 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Flavor limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:20:54 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Image limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:20:54 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Flavor pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:20:54 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Image pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:20:54 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:20:54 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:20:54 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:20:54 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:20:54 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:20:54 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:20:54 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:20:54 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Getting quotas for project ddc05e9bf5ab426982ccb3092ad596e4. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:20:54 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Getting quotas for user 1d60ce27bfad4d7c9b976e834df35ad4 and project ddc05e9bf5ab426982ccb3092ad596e4. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:20:54 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Going to run 1 instances... {{(pid=61167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:20:54 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52fe638c-5ada-47d5-b376-233bfa808a37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:20:54 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 2.718002 Apr 11 15:20:54 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 22/62] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 15:20:51 2023] POST /compute/v2.1/servers => generated 378 bytes in 2720 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 15:20:54 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-929f00c0-33c0-483f-b61b-503d4658cbc1 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:20:54 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-929f00c0-33c0-483f-b61b-503d4658cbc1 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:20:54 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-929f00c0-33c0-483f-b61b-503d4658cbc1 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:20:54 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-929f00c0-33c0-483f-b61b-503d4658cbc1 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:20:54 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-929f00c0-33c0-483f-b61b-503d4658cbc1 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:20:54 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-929f00c0-33c0-483f-b61b-503d4658cbc1 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de1a45fd-27be-4438-80a4-2f3a100643c9" status: 200 len: 1395 microversion: 2.87 time: 0.191373 Apr 11 15:20:54 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 21/63] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:20:54 2023] GET /compute/v2.1/servers/de1a45fd-27be-4438-80a4-2f3a100643c9 => generated 1395 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:20:55 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1908410251", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "networks": [{"uuid": "7c5ce6d1-32c2-4fd9-a28f-234811470f19"}]}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:20:55 user devstack@n-api.service[61166]: DEBUG nova.network.neutron [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] validate_networks() for [('7c5ce6d1-32c2-4fd9-a28f-234811470f19', None, None, None, None, None)] {{(pid=61166) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:20:56 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Flavor limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:20:56 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Image limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:20:56 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Flavor pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:20:56 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Image pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:20:56 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:20:56 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:20:56 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:20:56 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:20:56 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:20:56 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:20:56 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:20:56 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Getting quotas for project bc574e5ba43d43029c450e4fa80ac501. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:20:56 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Getting quotas for user 6b62270e2c254a888625c7e4491adf05 and project bc574e5ba43d43029c450e4fa80ac501. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:20:56 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Going to run 1 instances... {{(pid=61166) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:20:56 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52fe638c-5ada-47d5-b376-233bfa808a37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:20:57 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.776769 Apr 11 15:20:57 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 21/64] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 15:20:55 2023] POST /compute/v2.1/servers => generated 378 bytes in 1780 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 15:20:57 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-45e1d560-a89b-4100-bad6-54fdda43c217 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:20:57 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-45e1d560-a89b-4100-bad6-54fdda43c217 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:20:57 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-45e1d560-a89b-4100-bad6-54fdda43c217 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b62270e2c254a888625c7e4491adf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc574e5ba43d43029c450e4fa80ac501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:20:57 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-45e1d560-a89b-4100-bad6-54fdda43c217 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/074896e5-8065-4b4a-b61a-653bc67718db" status: 200 len: 1209 microversion: 2.1 time: 0.203202 Apr 11 15:20:57 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 22/65] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:20:57 2023] GET /compute/v2.1/servers/074896e5-8065-4b4a-b61a-653bc67718db => generated 1209 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:20:57 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-66fe4a04-9433-43dd-abd8-6654cb481bd9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Action: 'create', calling method: .version_select at 0x7f4c2fb72e60>, body: {"keypair": {"name": "tempest-keypair-1137963694", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfAJGQ+GOa8zW+jlKgD9Kz6/k6iEv9pZIOIjICzcstJ92AAS94+47mc3fRsqyx5FaTMV9P4lTsW4Fy7tKIAtMpRx0Sl7sa6ttQnPbPhlcYqfbdWbTqmmKi6+BuZpqSknA=="}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:20:57 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-66fe4a04-9433-43dd-abd8-6654cb481bd9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Getting quotas for project bb7660e8f76b471487136806ee9eec62. Resources: {'key_pairs'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:20:57 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-66fe4a04-9433-43dd-abd8-6654cb481bd9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Getting quotas for user 10720df0ac4f4e62a0a5c9883d600add and project bb7660e8f76b471487136806ee9eec62. Resources: {'key_pairs'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:20:57 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-66fe4a04-9433-43dd-abd8-6654cb481bd9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.409741 Apr 11 15:20:57 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 23/66] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 15:20:57 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:21:02 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-e84d76d0-a1bf-4087-bb5f-fc05abd2a3f9 req-aa3212a3-dfe4-4722-a743-d65e4303b3c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "074896e5-8065-4b4a-b61a-653bc67718db", "tag": "b0a1c8e2-240f-45dc-bfcc-24902144caf8"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:21:02 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-e84d76d0-a1bf-4087-bb5f-fc05abd2a3f9 req-aa3212a3-dfe4-4722-a743-d65e4303b3c3 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:02 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-e84d76d0-a1bf-4087-bb5f-fc05abd2a3f9 req-aa3212a3-dfe4-4722-a743-d65e4303b3c3 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:02 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-e84d76d0-a1bf-4087-bb5f-fc05abd2a3f9 req-aa3212a3-dfe4-4722-a743-d65e4303b3c3 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:02 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-e84d76d0-a1bf-4087-bb5f-fc05abd2a3f9 req-aa3212a3-dfe4-4722-a743-d65e4303b3c3 service nova] Creating event network-changed:b0a1c8e2-240f-45dc-bfcc-24902144caf8 for instance 074896e5-8065-4b4a-b61a-653bc67718db on user Apr 11 15:21:02 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-e84d76d0-a1bf-4087-bb5f-fc05abd2a3f9 req-aa3212a3-dfe4-4722-a743-d65e4303b3c3 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61166) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 11 15:21:02 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-e84d76d0-a1bf-4087-bb5f-fc05abd2a3f9 req-aa3212a3-dfe4-4722-a743-d65e4303b3c3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61166) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 11 15:21:02 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-cd65f462-a279-4625-a41e-d72ac08e01cf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:02 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-cd65f462-a279-4625-a41e-d72ac08e01cf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:02 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-cd65f462-a279-4625-a41e-d72ac08e01cf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:02 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-cd65f462-a279-4625-a41e-d72ac08e01cf None None] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:02 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-cd65f462-a279-4625-a41e-d72ac08e01cf None None] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:02 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-cd65f462-a279-4625-a41e-d72ac08e01cf None None] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:02 user devstack@n-api.service[61166]: INFO nova.compute.rpcapi [None req-cd65f462-a279-4625-a41e-d72ac08e01cf None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 11 15:21:02 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-cd65f462-a279-4625-a41e-d72ac08e01cf None None] Releasing lock "compute-rpcapi-router" {{(pid=61166) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 11 15:21:02 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-cd65f462-a279-4625-a41e-d72ac08e01cf None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.227751 Apr 11 15:21:02 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 22/67] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:21:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:21:03 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1386574519", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "1bd215e8-0459-4dd2-893b-096b6e31ac08"}], "security_groups": [{"name": "tempest-securitygroup--1617652564"}], "key_name": "tempest-keypair-1137963694", "user_data": "}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:21:03 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-0a63d9e8-6b7b-48a0-9cfd-f78a811c24b9 req-062d28fd-d557-46b5-935f-a179c7e13a71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de1a45fd-27be-4438-80a4-2f3a100643c9", "tag": "197ae974-459a-49ab-9d70-89bfaa073f50"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:21:03 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-0a63d9e8-6b7b-48a0-9cfd-f78a811c24b9 req-062d28fd-d557-46b5-935f-a179c7e13a71 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:03 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-0a63d9e8-6b7b-48a0-9cfd-f78a811c24b9 req-062d28fd-d557-46b5-935f-a179c7e13a71 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:03 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-0a63d9e8-6b7b-48a0-9cfd-f78a811c24b9 req-062d28fd-d557-46b5-935f-a179c7e13a71 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:03 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-0a63d9e8-6b7b-48a0-9cfd-f78a811c24b9 req-062d28fd-d557-46b5-935f-a179c7e13a71 service nova] Creating event network-changed:197ae974-459a-49ab-9d70-89bfaa073f50 for instance de1a45fd-27be-4438-80a4-2f3a100643c9 on user Apr 11 15:21:03 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-0a63d9e8-6b7b-48a0-9cfd-f78a811c24b9 req-062d28fd-d557-46b5-935f-a179c7e13a71 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61165) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 11 15:21:03 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-0a63d9e8-6b7b-48a0-9cfd-f78a811c24b9 req-062d28fd-d557-46b5-935f-a179c7e13a71 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61165) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 11 15:21:03 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-fa958721-f52e-4623-b34b-a66b95571f2a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:03 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-fa958721-f52e-4623-b34b-a66b95571f2a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:03 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-fa958721-f52e-4623-b34b-a66b95571f2a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:03 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-fa958721-f52e-4623-b34b-a66b95571f2a None None] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:03 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-fa958721-f52e-4623-b34b-a66b95571f2a None None] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:03 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-fa958721-f52e-4623-b34b-a66b95571f2a None None] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:03 user devstack@n-api.service[61165]: INFO nova.compute.rpcapi [None req-fa958721-f52e-4623-b34b-a66b95571f2a None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 11 15:21:03 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-fa958721-f52e-4623-b34b-a66b95571f2a None None] Releasing lock "compute-rpcapi-router" {{(pid=61165) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 11 15:21:03 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-fa958721-f52e-4623-b34b-a66b95571f2a None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.361042 Apr 11 15:21:03 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 23/68] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:21:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:21:03 user devstack@n-api.service[61167]: DEBUG nova.network.neutron [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] validate_networks() for [('1bd215e8-0459-4dd2-893b-096b6e31ac08', None, None, None, None, None)] {{(pid=61167) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:21:04 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:21:04 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:21:04 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Flavor limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:21:04 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Image limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:21:04 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Flavor pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:21:04 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Image pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:21:04 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:21:04 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:04 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:04 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:04 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:04 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:04 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:04 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Getting quotas for project bb7660e8f76b471487136806ee9eec62. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:21:04 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Getting quotas for user 10720df0ac4f4e62a0a5c9883d600add and project bb7660e8f76b471487136806ee9eec62. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:21:04 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Going to run 1 instances... {{(pid=61167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:21:04 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52fe638c-5ada-47d5-b376-233bfa808a37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:21:04 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.637832 Apr 11 15:21:04 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 24/69] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 15:21:03 2023] POST /compute/v2.1/servers => generated 407 bytes in 1644 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 15:21:04 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-a6f174ce-b804-4f8b-90c5-e48b4e936ac6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:21:04 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-a6f174ce-b804-4f8b-90c5-e48b4e936ac6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:21:05 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-a6f174ce-b804-4f8b-90c5-e48b4e936ac6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:21:05 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-a6f174ce-b804-4f8b-90c5-e48b4e936ac6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35" status: 200 len: 1233 microversion: 2.1 time: 0.126824 Apr 11 15:21:05 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 23/70] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:21:04 2023] GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35 => generated 1233 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:21:08 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:21:08 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-d0f2f249-e0b3-4178-abf1-a6c5c343296e req-80aeba7d-4d3a-488f-a5d8-3e6ff653afc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "074896e5-8065-4b4a-b61a-653bc67718db", "name": "network-vif-plugged", "status": "completed", "tag": "b0a1c8e2-240f-45dc-bfcc-24902144caf8"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:21:08 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-d0f2f249-e0b3-4178-abf1-a6c5c343296e req-80aeba7d-4d3a-488f-a5d8-3e6ff653afc5 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:08 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-d0f2f249-e0b3-4178-abf1-a6c5c343296e req-80aeba7d-4d3a-488f-a5d8-3e6ff653afc5 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:08 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-d0f2f249-e0b3-4178-abf1-a6c5c343296e req-80aeba7d-4d3a-488f-a5d8-3e6ff653afc5 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:08 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-d0f2f249-e0b3-4178-abf1-a6c5c343296e req-80aeba7d-4d3a-488f-a5d8-3e6ff653afc5 service nova] Creating event network-vif-plugged:b0a1c8e2-240f-45dc-bfcc-24902144caf8 for instance 074896e5-8065-4b4a-b61a-653bc67718db on user Apr 11 15:21:08 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-d0f2f249-e0b3-4178-abf1-a6c5c343296e req-80aeba7d-4d3a-488f-a5d8-3e6ff653afc5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204696 Apr 11 15:21:08 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 24/71] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:21:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 15:21:10 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-4ffdc735-ff60-4383-8bee-cc37139dad2c req-036c9c5c-0614-4508-be41-bdd7a8ff972a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "074896e5-8065-4b4a-b61a-653bc67718db", "name": "network-vif-plugged", "status": "completed", "tag": "b0a1c8e2-240f-45dc-bfcc-24902144caf8"}, {"server_uuid": "de1a45fd-27be-4438-80a4-2f3a100643c9", "name": "network-vif-plugged", "status": "completed", "tag": "197ae974-459a-49ab-9d70-89bfaa073f50"}, {"server_uuid": "de1a45fd-27be-4438-80a4-2f3a100643c9", "name": "network-vif-plugged", "status": "completed", "tag": "197ae974-459a-49ab-9d70-89bfaa073f50"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:21:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-4ffdc735-ff60-4383-8bee-cc37139dad2c req-036c9c5c-0614-4508-be41-bdd7a8ff972a service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-4ffdc735-ff60-4383-8bee-cc37139dad2c req-036c9c5c-0614-4508-be41-bdd7a8ff972a service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-4ffdc735-ff60-4383-8bee-cc37139dad2c req-036c9c5c-0614-4508-be41-bdd7a8ff972a service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:10 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-4ffdc735-ff60-4383-8bee-cc37139dad2c req-036c9c5c-0614-4508-be41-bdd7a8ff972a service nova] Creating event network-vif-plugged:b0a1c8e2-240f-45dc-bfcc-24902144caf8 for instance 074896e5-8065-4b4a-b61a-653bc67718db on user Apr 11 15:21:10 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-4ffdc735-ff60-4383-8bee-cc37139dad2c req-036c9c5c-0614-4508-be41-bdd7a8ff972a service nova] Creating event network-vif-plugged:197ae974-459a-49ab-9d70-89bfaa073f50 for instance de1a45fd-27be-4438-80a4-2f3a100643c9 on user Apr 11 15:21:10 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-4ffdc735-ff60-4383-8bee-cc37139dad2c req-036c9c5c-0614-4508-be41-bdd7a8ff972a service nova] Creating event network-vif-plugged:197ae974-459a-49ab-9d70-89bfaa073f50 for instance de1a45fd-27be-4438-80a4-2f3a100643c9 on user Apr 11 15:21:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-4ffdc735-ff60-4383-8bee-cc37139dad2c req-036c9c5c-0614-4508-be41-bdd7a8ff972a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61167) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 11 15:21:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-4ffdc735-ff60-4383-8bee-cc37139dad2c req-036c9c5c-0614-4508-be41-bdd7a8ff972a service nova] Acquired lock "compute-rpcapi-router" {{(pid=61167) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 11 15:21:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-df259b38-b2f2-4ac1-950f-8698ad209fd7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-df259b38-b2f2-4ac1-950f-8698ad209fd7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-df259b38-b2f2-4ac1-950f-8698ad209fd7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-df259b38-b2f2-4ac1-950f-8698ad209fd7 None None] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-df259b38-b2f2-4ac1-950f-8698ad209fd7 None None] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-df259b38-b2f2-4ac1-950f-8698ad209fd7 None None] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:10 user devstack@n-api.service[61167]: INFO nova.compute.rpcapi [None req-df259b38-b2f2-4ac1-950f-8698ad209fd7 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 11 15:21:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-df259b38-b2f2-4ac1-950f-8698ad209fd7 None None] Releasing lock "compute-rpcapi-router" {{(pid=61167) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 11 15:21:10 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-df259b38-b2f2-4ac1-950f-8698ad209fd7 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.172053 Apr 11 15:21:10 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 25/72] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:21:10 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:21:13 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-934769884", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "networks": [{"uuid": "5b9dc948-4f8b-460a-bc87-04cf194f5c08"}]}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:21:13 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:21:13 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:21:13 user devstack@n-api.service[61166]: DEBUG nova.network.neutron [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] validate_networks() for [('5b9dc948-4f8b-460a-bc87-04cf194f5c08', None, None, None, None, None)] {{(pid=61166) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:21:14 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Flavor limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:21:14 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Image limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:21:14 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Flavor pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:21:14 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Image pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:21:14 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:21:14 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:14 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:14 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:14 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:14 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:14 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:14 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Getting quotas for project b4a341ccfc0b4f08bb2e97083143dd40. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:21:14 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Getting quotas for user acc44d2042554ca0b0bde4b2de5b566a and project b4a341ccfc0b4f08bb2e97083143dd40. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:21:14 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Going to run 1 instances... {{(pid=61166) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:21:14 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52fe638c-5ada-47d5-b376-233bfa808a37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:21:14 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.051184 Apr 11 15:21:14 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 24/73] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 15:21:13 2023] POST /compute/v2.1/servers => generated 378 bytes in 1054 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 15:21:14 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:21:14 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-5c9ed0c8-a8de-4f11-93b5-a9a13fe913ff tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:21:14 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-5c9ed0c8-a8de-4f11-93b5-a9a13fe913ff tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:21:15 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=16 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:21:15 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-79627368-691b-4caa-92d0-9e54d0b45e6d req-e55a1bc2-8bf2-4f49-9800-92e5ba8724d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a805345-374c-4326-9e8f-39bfc7947a35", "tag": "d8c64197-b034-4f38-821d-ba030f1fca6b"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:21:15 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-5c9ed0c8-a8de-4f11-93b5-a9a13fe913ff tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc44d2042554ca0b0bde4b2de5b566a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a341ccfc0b4f08bb2e97083143dd40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:21:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-79627368-691b-4caa-92d0-9e54d0b45e6d req-e55a1bc2-8bf2-4f49-9800-92e5ba8724d3 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-79627368-691b-4caa-92d0-9e54d0b45e6d req-e55a1bc2-8bf2-4f49-9800-92e5ba8724d3 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-79627368-691b-4caa-92d0-9e54d0b45e6d req-e55a1bc2-8bf2-4f49-9800-92e5ba8724d3 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:15 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-5c9ed0c8-a8de-4f11-93b5-a9a13fe913ff tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b1dedd0-ae18-421b-b83a-a7b2c22c65d5" status: 200 len: 1207 microversion: 2.1 time: 0.118901 Apr 11 15:21:15 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 25/74] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:21:14 2023] GET /compute/v2.1/servers/4b1dedd0-ae18-421b-b83a-a7b2c22c65d5 => generated 1207 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:21:15 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-79627368-691b-4caa-92d0-9e54d0b45e6d req-e55a1bc2-8bf2-4f49-9800-92e5ba8724d3 service nova] Creating event network-changed:d8c64197-b034-4f38-821d-ba030f1fca6b for instance 6a805345-374c-4326-9e8f-39bfc7947a35 on user Apr 11 15:21:15 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-989c8d61-0a54-4da9-aa49-c22a33862d62 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Action: 'create', calling method: .version_select at 0x7f4c2fbe67a0>, body: {"keypair": {"name": "tempest-keypair-445229818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXe2oYf9bHTZuGSH+I98VCNh4n8J86bhrRtZei09K0Pc1rXzA6ZGLlg6dYTh2vwT7HQFXKOvrkAxNKF8kQZmFeBvV71cpVJ8itjkiYcKvNJUpIPXBRA/2eZnMt0gU1MDg=="}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:21:15 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-79627368-691b-4caa-92d0-9e54d0b45e6d req-e55a1bc2-8bf2-4f49-9800-92e5ba8724d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077019 Apr 11 15:21:15 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 26/75] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:21:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:21:15 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-989c8d61-0a54-4da9-aa49-c22a33862d62 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Getting quotas for project f7c88bf2782342c8af04195140d6cd0e. Resources: {'key_pairs'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:21:15 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-989c8d61-0a54-4da9-aa49-c22a33862d62 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Getting quotas for user a2ec75db561b4fec903a1a391c3d03e3 and project f7c88bf2782342c8af04195140d6cd0e. Resources: {'key_pairs'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:21:15 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-989c8d61-0a54-4da9-aa49-c22a33862d62 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.120421 Apr 11 15:21:15 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 25/76] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 15:21:15 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:21:16 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-95161b1c-5790-4056-841b-1fe75e1f63fa tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Action: 'create', calling method: .version_select at 0x7f4c2fb80ca0>, body: {"keypair": {"name": "tempest-keypair-1249294022", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7+kKApk4z8FCEvSKm9HfkBqfdxWArp+jnXBl4IzRHHwFU8PNMf4o+BnC57wgCpXRd4hoyh/vOZAwA+9ZsLsFmqPY0D3TlKuGhbcr3CvY7kzHuI+987FATt2twOLazm+w=="}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:21:16 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-95161b1c-5790-4056-841b-1fe75e1f63fa tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Getting quotas for project da140971126a4d298ff718275e7a22ec. Resources: {'key_pairs'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:21:16 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-95161b1c-5790-4056-841b-1fe75e1f63fa tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Getting quotas for user 2717e456dcc941899c48c3c973083bd4 and project da140971126a4d298ff718275e7a22ec. Resources: {'key_pairs'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:21:16 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-95161b1c-5790-4056-841b-1fe75e1f63fa tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.590705 Apr 11 15:21:16 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 26/77] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 15:21:16 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:21:19 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-fcb812d1-edd6-4701-ab50-6f2ccec1c243 req-c95d44be-9377-49a5-ba15-aeabac02ebf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a805345-374c-4326-9e8f-39bfc7947a35", "name": "network-vif-plugged", "status": "completed", "tag": "d8c64197-b034-4f38-821d-ba030f1fca6b"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:21:19 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-fcb812d1-edd6-4701-ab50-6f2ccec1c243 req-c95d44be-9377-49a5-ba15-aeabac02ebf6 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:19 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-fcb812d1-edd6-4701-ab50-6f2ccec1c243 req-c95d44be-9377-49a5-ba15-aeabac02ebf6 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:19 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-fcb812d1-edd6-4701-ab50-6f2ccec1c243 req-c95d44be-9377-49a5-ba15-aeabac02ebf6 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:19 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-fcb812d1-edd6-4701-ab50-6f2ccec1c243 req-c95d44be-9377-49a5-ba15-aeabac02ebf6 service nova] Creating event network-vif-plugged:d8c64197-b034-4f38-821d-ba030f1fca6b for instance 6a805345-374c-4326-9e8f-39bfc7947a35 on user Apr 11 15:21:19 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-fcb812d1-edd6-4701-ab50-6f2ccec1c243 req-c95d44be-9377-49a5-ba15-aeabac02ebf6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047873 Apr 11 15:21:19 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 27/78] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:21:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:21:19 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-1927487601", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "networks": [{"uuid": "d861c3b4-c929-43bb-83c3-e746f8119831"}], "security_groups": [{"name": "tempest-securitygroup--1633544712"}], "key_name": "tempest-keypair-445229818", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:21:19 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=7 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:21:19 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:21:19 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-11476a04-9b73-41d6-8271-1606330f9b17 req-3fb2fd54-cec8-4644-98e1-8efb6ae868c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b1dedd0-ae18-421b-b83a-a7b2c22c65d5", "tag": "e92694db-c1b5-4366-bf78-1f6340cab2fe"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:21:19 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-11476a04-9b73-41d6-8271-1606330f9b17 req-3fb2fd54-cec8-4644-98e1-8efb6ae868c6 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:19 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-11476a04-9b73-41d6-8271-1606330f9b17 req-3fb2fd54-cec8-4644-98e1-8efb6ae868c6 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:19 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-11476a04-9b73-41d6-8271-1606330f9b17 req-3fb2fd54-cec8-4644-98e1-8efb6ae868c6 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:20 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-11476a04-9b73-41d6-8271-1606330f9b17 req-3fb2fd54-cec8-4644-98e1-8efb6ae868c6 service nova] Creating event network-changed:e92694db-c1b5-4366-bf78-1f6340cab2fe for instance 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5 on user Apr 11 15:21:20 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-11476a04-9b73-41d6-8271-1606330f9b17 req-3fb2fd54-cec8-4644-98e1-8efb6ae868c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084890 Apr 11 15:21:20 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 27/79] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:21:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:21:20 user devstack@n-api.service[61166]: DEBUG nova.network.neutron [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] validate_networks() for [('d861c3b4-c929-43bb-83c3-e746f8119831', None, None, None, None, None)] {{(pid=61166) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:21:20 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Flavor limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:21:20 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Image limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:21:20 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Flavor pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:21:20 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Image pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:21:20 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:21:20 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:20 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:20 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:20 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:20 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:20 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:20 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Getting quotas for project f7c88bf2782342c8af04195140d6cd0e. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:21:20 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Getting quotas for user a2ec75db561b4fec903a1a391c3d03e3 and project f7c88bf2782342c8af04195140d6cd0e. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:21:20 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Going to run 1 instances... {{(pid=61166) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:21:20 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52fe638c-5ada-47d5-b376-233bfa808a37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:21:20 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=4 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:21:20 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.996922 Apr 11 15:21:20 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 26/80] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 15:21:19 2023] POST /compute/v2.1/servers => generated 404 bytes in 999 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 15:21:20 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-299929658", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "networks": [{"uuid": "f52bd4a9-1843-408b-85af-c2124ad01be7"}], "security_groups": [{"name": "tempest-securitygroup--2005587233"}], "key_name": "tempest-keypair-1249294022", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:21:20 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-1e73f28b-2e75-4044-832e-692a4440800b tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:21:20 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-1e73f28b-2e75-4044-832e-692a4440800b tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:21:21 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-1e73f28b-2e75-4044-832e-692a4440800b tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ec75db561b4fec903a1a391c3d03e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c88bf2782342c8af04195140d6cd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:21:21 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-1e73f28b-2e75-4044-832e-692a4440800b tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d84862f-b710-48b1-9275-93fc799cf1f9" status: 200 len: 1225 microversion: 2.1 time: 0.470742 Apr 11 15:21:21 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 28/81] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:21:20 2023] GET /compute/v2.1/servers/8d84862f-b710-48b1-9275-93fc799cf1f9 => generated 1225 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:21:21 user devstack@n-api.service[61167]: DEBUG nova.network.neutron [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] validate_networks() for [('f52bd4a9-1843-408b-85af-c2124ad01be7', None, None, None, None, None)] {{(pid=61167) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:21:21 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-7a42968a-3801-4e12-9eae-a1701887dd1f req-df32e56e-9c45-4531-a68b-47b2fe76f2ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a805345-374c-4326-9e8f-39bfc7947a35", "name": "network-vif-plugged", "status": "completed", "tag": "d8c64197-b034-4f38-821d-ba030f1fca6b"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:21:21 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-7a42968a-3801-4e12-9eae-a1701887dd1f req-df32e56e-9c45-4531-a68b-47b2fe76f2ed service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:21 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-7a42968a-3801-4e12-9eae-a1701887dd1f req-df32e56e-9c45-4531-a68b-47b2fe76f2ed service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:21 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-7a42968a-3801-4e12-9eae-a1701887dd1f req-df32e56e-9c45-4531-a68b-47b2fe76f2ed service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:21 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-7a42968a-3801-4e12-9eae-a1701887dd1f req-df32e56e-9c45-4531-a68b-47b2fe76f2ed service nova] Creating event network-vif-plugged:d8c64197-b034-4f38-821d-ba030f1fca6b for instance 6a805345-374c-4326-9e8f-39bfc7947a35 on user Apr 11 15:21:21 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-7a42968a-3801-4e12-9eae-a1701887dd1f req-df32e56e-9c45-4531-a68b-47b2fe76f2ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083500 Apr 11 15:21:21 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 27/82] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:21:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:21:22 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=7 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:21:22 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Flavor limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:21:22 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Image limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:21:22 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Flavor pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:21:22 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Image pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:21:22 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:21:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:22 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Getting quotas for project da140971126a4d298ff718275e7a22ec. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:21:22 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Getting quotas for user 2717e456dcc941899c48c3c973083bd4 and project da140971126a4d298ff718275e7a22ec. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:21:22 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Going to run 1 instances... {{(pid=61167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:21:22 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52fe638c-5ada-47d5-b376-233bfa808a37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:21:22 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.872520 Apr 11 15:21:22 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 28/83] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 15:21:20 2023] POST /compute/v2.1/servers => generated 404 bytes in 1874 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 15:21:22 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-15d3b1e2-1b8e-4aa2-ad92-6190e3f765b6 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:21:22 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-15d3b1e2-1b8e-4aa2-ad92-6190e3f765b6 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:21:22 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-15d3b1e2-1b8e-4aa2-ad92-6190e3f765b6 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2717e456dcc941899c48c3c973083bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da140971126a4d298ff718275e7a22ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:21:22 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-15d3b1e2-1b8e-4aa2-ad92-6190e3f765b6 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3a06747-0f43-4731-87e6-40629c382a6b" status: 200 len: 1235 microversion: 2.1 time: 0.185061 Apr 11 15:21:22 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 29/84] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:21:22 2023] GET /compute/v2.1/servers/f3a06747-0f43-4731-87e6-40629c382a6b => generated 1235 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:21:23 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-086376fa-985a-4a3a-9c38-88e3e36b6932 req-ae48e5b5-9418-4ee8-9c9e-4fedd186e27a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b1dedd0-ae18-421b-b83a-a7b2c22c65d5", "name": "network-vif-plugged", "status": "completed", "tag": "e92694db-c1b5-4366-bf78-1f6340cab2fe"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:21:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-086376fa-985a-4a3a-9c38-88e3e36b6932 req-ae48e5b5-9418-4ee8-9c9e-4fedd186e27a service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-086376fa-985a-4a3a-9c38-88e3e36b6932 req-ae48e5b5-9418-4ee8-9c9e-4fedd186e27a service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-086376fa-985a-4a3a-9c38-88e3e36b6932 req-ae48e5b5-9418-4ee8-9c9e-4fedd186e27a service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:23 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-086376fa-985a-4a3a-9c38-88e3e36b6932 req-ae48e5b5-9418-4ee8-9c9e-4fedd186e27a service nova] Creating event network-vif-plugged:e92694db-c1b5-4366-bf78-1f6340cab2fe for instance 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5 on user Apr 11 15:21:23 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-086376fa-985a-4a3a-9c38-88e3e36b6932 req-ae48e5b5-9418-4ee8-9c9e-4fedd186e27a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057438 Apr 11 15:21:23 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 28/85] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:21:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:21:24 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-349f605b-febd-4391-b1e7-7c518d3f6ef5 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Action: 'create', calling method: .version_select at 0x7f4c2fb8e050>, body: {"keypair": {"name": "tempest-keypair-1093697918", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFG+zxkXnTpf+p02vM4Xm045ubcRVkYMQB82y2IimhiNqNrzMiV7JBv5D8QDKrCrIsbmJVrkWShxDADZaCrqirBShJpvYeU0v7+/LyAPe6u+e6K/qaIcS7cSvQZjtrOk2A=="}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:21:24 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-349f605b-febd-4391-b1e7-7c518d3f6ef5 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Getting quotas for project 7e67f7203b1849c0af305f88ad8284f9. Resources: {'key_pairs'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:21:24 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-349f605b-febd-4391-b1e7-7c518d3f6ef5 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Getting quotas for user cab8ba2ebb8643a59d3a8a821cd1c2f1 and project 7e67f7203b1849c0af305f88ad8284f9. Resources: {'key_pairs'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:21:24 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-349f605b-febd-4391-b1e7-7c518d3f6ef5 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.374213 Apr 11 15:21:24 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 29/86] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 15:21:23 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:21:25 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-42692eef-fe8d-416c-afb9-04db6b7fa634 req-e3ba58b1-e8fd-41c8-9928-6960b79ea6f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b1dedd0-ae18-421b-b83a-a7b2c22c65d5", "name": "network-vif-plugged", "status": "completed", "tag": "e92694db-c1b5-4366-bf78-1f6340cab2fe"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:21:25 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:21:25 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-42692eef-fe8d-416c-afb9-04db6b7fa634 req-e3ba58b1-e8fd-41c8-9928-6960b79ea6f2 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:25 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-42692eef-fe8d-416c-afb9-04db6b7fa634 req-e3ba58b1-e8fd-41c8-9928-6960b79ea6f2 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:25 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-42692eef-fe8d-416c-afb9-04db6b7fa634 req-e3ba58b1-e8fd-41c8-9928-6960b79ea6f2 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:25 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-42692eef-fe8d-416c-afb9-04db6b7fa634 req-e3ba58b1-e8fd-41c8-9928-6960b79ea6f2 service nova] Creating event network-vif-plugged:e92694db-c1b5-4366-bf78-1f6340cab2fe for instance 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5 on user Apr 11 15:21:25 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-42692eef-fe8d-416c-afb9-04db6b7fa634 req-e3ba58b1-e8fd-41c8-9928-6960b79ea6f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058507 Apr 11 15:21:25 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 30/87] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:21:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:21:27 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1731751351", "imageRef": "3e614d46-369e-4f7d-9d40-f3e9759f60f3", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "5709c284-0131-449d-869b-bfcf88bbe239"}], "security_groups": [{"name": "tempest-securitygroup--118176598"}], "key_name": "tempest-keypair-1093697918", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:21:27 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-f74d660c-0ea7-46c6-a228-1558f1256ae1 req-f850db52-2db2-43de-8512-fe1320ce30e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3a06747-0f43-4731-87e6-40629c382a6b", "tag": "a7049f98-5ea1-4167-be7f-3206830f17c4"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:21:27 user devstack@n-api.service[61166]: DEBUG nova.network.neutron [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] validate_networks() for [('5709c284-0131-449d-869b-bfcf88bbe239', None, None, None, None, None)] {{(pid=61166) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:21:27 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-f74d660c-0ea7-46c6-a228-1558f1256ae1 req-f850db52-2db2-43de-8512-fe1320ce30e0 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:27 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-f74d660c-0ea7-46c6-a228-1558f1256ae1 req-f850db52-2db2-43de-8512-fe1320ce30e0 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:27 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-f74d660c-0ea7-46c6-a228-1558f1256ae1 req-f850db52-2db2-43de-8512-fe1320ce30e0 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:27 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-f74d660c-0ea7-46c6-a228-1558f1256ae1 req-f850db52-2db2-43de-8512-fe1320ce30e0 service nova] Creating event network-changed:a7049f98-5ea1-4167-be7f-3206830f17c4 for instance f3a06747-0f43-4731-87e6-40629c382a6b on user Apr 11 15:21:27 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-f74d660c-0ea7-46c6-a228-1558f1256ae1 req-f850db52-2db2-43de-8512-fe1320ce30e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060415 Apr 11 15:21:27 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 30/88] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:21:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:21:27 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Flavor limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:21:27 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Image limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:21:27 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Flavor pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:21:27 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Image pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:21:27 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:21:27 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=25 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:21:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:27 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-7eb30856-b9d7-477b-9b97-07908a6005ea req-e26b84f2-3a9c-401a-b1f6-17734bc28b27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d84862f-b710-48b1-9275-93fc799cf1f9", "tag": "bcba48c0-9931-4249-925c-57cb387499d1"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:21:27 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Getting quotas for project 7e67f7203b1849c0af305f88ad8284f9. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:21:27 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Getting quotas for user cab8ba2ebb8643a59d3a8a821cd1c2f1 and project 7e67f7203b1849c0af305f88ad8284f9. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:21:27 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-7eb30856-b9d7-477b-9b97-07908a6005ea req-e26b84f2-3a9c-401a-b1f6-17734bc28b27 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:27 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-7eb30856-b9d7-477b-9b97-07908a6005ea req-e26b84f2-3a9c-401a-b1f6-17734bc28b27 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:27 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-7eb30856-b9d7-477b-9b97-07908a6005ea req-e26b84f2-3a9c-401a-b1f6-17734bc28b27 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:27 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Going to run 1 instances... {{(pid=61166) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:21:27 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3e614d46-369e-4f7d-9d40-f3e9759f60f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:21:27 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-7eb30856-b9d7-477b-9b97-07908a6005ea req-e26b84f2-3a9c-401a-b1f6-17734bc28b27 service nova] Creating event network-changed:bcba48c0-9931-4249-925c-57cb387499d1 for instance 8d84862f-b710-48b1-9275-93fc799cf1f9 on user Apr 11 15:21:27 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-7eb30856-b9d7-477b-9b97-07908a6005ea req-e26b84f2-3a9c-401a-b1f6-17734bc28b27 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048247 Apr 11 15:21:27 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 31/89] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:21:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 15:21:27 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.670393 Apr 11 15:21:27 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 29/90] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 15:21:27 2023] POST /compute/v2.1/servers => generated 403 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 15:21:28 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-07387eb5-c077-474a-8423-3eecda301a8b tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:21:28 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-07387eb5-c077-474a-8423-3eecda301a8b tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:21:28 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-07387eb5-c077-474a-8423-3eecda301a8b tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab8ba2ebb8643a59d3a8a821cd1c2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67f7203b1849c0af305f88ad8284f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:21:28 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-07387eb5-c077-474a-8423-3eecda301a8b tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2b2c294d-49b2-41bf-89d0-17a560e7741f" status: 200 len: 1240 microversion: 2.1 time: 0.142046 Apr 11 15:21:28 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 31/91] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:21:27 2023] GET /compute/v2.1/servers/2b2c294d-49b2-41bf-89d0-17a560e7741f => generated 1240 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:21:28 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-7ba74311-13ee-43a2-bd26-217be0aa95e4 req-20fc7a71-f3db-4d6f-9bd7-920d6f4e33c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d84862f-b710-48b1-9275-93fc799cf1f9", "name": "network-vif-plugged", "status": "completed", "tag": "bcba48c0-9931-4249-925c-57cb387499d1"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:21:28 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-7ba74311-13ee-43a2-bd26-217be0aa95e4 req-20fc7a71-f3db-4d6f-9bd7-920d6f4e33c8 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:28 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-7ba74311-13ee-43a2-bd26-217be0aa95e4 req-20fc7a71-f3db-4d6f-9bd7-920d6f4e33c8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:28 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-7ba74311-13ee-43a2-bd26-217be0aa95e4 req-20fc7a71-f3db-4d6f-9bd7-920d6f4e33c8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:28 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-7ba74311-13ee-43a2-bd26-217be0aa95e4 req-20fc7a71-f3db-4d6f-9bd7-920d6f4e33c8 service nova] Creating event network-vif-plugged:bcba48c0-9931-4249-925c-57cb387499d1 for instance 8d84862f-b710-48b1-9275-93fc799cf1f9 on user Apr 11 15:21:28 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-7ba74311-13ee-43a2-bd26-217be0aa95e4 req-20fc7a71-f3db-4d6f-9bd7-920d6f4e33c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070460 Apr 11 15:21:28 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 32/92] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:21:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:21:30 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-37f050b8-de7f-4e58-bd0b-10e86bf168e7 req-7fde8fde-c53c-46fe-be98-868b6f2785c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3a06747-0f43-4731-87e6-40629c382a6b", "name": "network-vif-plugged", "status": "completed", "tag": "a7049f98-5ea1-4167-be7f-3206830f17c4"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:21:30 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-37f050b8-de7f-4e58-bd0b-10e86bf168e7 req-7fde8fde-c53c-46fe-be98-868b6f2785c8 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:30 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-37f050b8-de7f-4e58-bd0b-10e86bf168e7 req-7fde8fde-c53c-46fe-be98-868b6f2785c8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:30 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-37f050b8-de7f-4e58-bd0b-10e86bf168e7 req-7fde8fde-c53c-46fe-be98-868b6f2785c8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:30 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-37f050b8-de7f-4e58-bd0b-10e86bf168e7 req-7fde8fde-c53c-46fe-be98-868b6f2785c8 service nova] Creating event network-vif-plugged:a7049f98-5ea1-4167-be7f-3206830f17c4 for instance f3a06747-0f43-4731-87e6-40629c382a6b on user Apr 11 15:21:30 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-37f050b8-de7f-4e58-bd0b-10e86bf168e7 req-7fde8fde-c53c-46fe-be98-868b6f2785c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046700 Apr 11 15:21:30 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 30/93] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:21:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:21:30 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-84f9e764-e387-4aee-a2cc-68b6e3aa1e93 req-552b0f46-89f0-48da-b9a1-a01e007fd784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d84862f-b710-48b1-9275-93fc799cf1f9", "name": "network-vif-plugged", "status": "completed", "tag": "bcba48c0-9931-4249-925c-57cb387499d1"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:21:30 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-84f9e764-e387-4aee-a2cc-68b6e3aa1e93 req-552b0f46-89f0-48da-b9a1-a01e007fd784 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:30 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-84f9e764-e387-4aee-a2cc-68b6e3aa1e93 req-552b0f46-89f0-48da-b9a1-a01e007fd784 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:30 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-84f9e764-e387-4aee-a2cc-68b6e3aa1e93 req-552b0f46-89f0-48da-b9a1-a01e007fd784 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:30 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-84f9e764-e387-4aee-a2cc-68b6e3aa1e93 req-552b0f46-89f0-48da-b9a1-a01e007fd784 service nova] Creating event network-vif-plugged:bcba48c0-9931-4249-925c-57cb387499d1 for instance 8d84862f-b710-48b1-9275-93fc799cf1f9 on user Apr 11 15:21:30 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-84f9e764-e387-4aee-a2cc-68b6e3aa1e93 req-552b0f46-89f0-48da-b9a1-a01e007fd784 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049614 Apr 11 15:21:30 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 32/94] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:21:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:21:32 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-120628292", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42"}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:21:32 user devstack@n-api.service[61165]: DEBUG nova.network.neutron [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] validate_networks() for None {{(pid=61165) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:21:32 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-c07f1845-7a90-4906-85ad-b730bebc21ec req-00e070f5-ec0d-4c80-9631-cc02bc51a084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3a06747-0f43-4731-87e6-40629c382a6b", "name": "network-vif-plugged", "status": "completed", "tag": "a7049f98-5ea1-4167-be7f-3206830f17c4"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:21:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-c07f1845-7a90-4906-85ad-b730bebc21ec req-00e070f5-ec0d-4c80-9631-cc02bc51a084 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-c07f1845-7a90-4906-85ad-b730bebc21ec req-00e070f5-ec0d-4c80-9631-cc02bc51a084 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-c07f1845-7a90-4906-85ad-b730bebc21ec req-00e070f5-ec0d-4c80-9631-cc02bc51a084 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:32 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-c07f1845-7a90-4906-85ad-b730bebc21ec req-00e070f5-ec0d-4c80-9631-cc02bc51a084 service nova] Creating event network-vif-plugged:a7049f98-5ea1-4167-be7f-3206830f17c4 for instance f3a06747-0f43-4731-87e6-40629c382a6b on user Apr 11 15:21:32 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-c07f1845-7a90-4906-85ad-b730bebc21ec req-00e070f5-ec0d-4c80-9631-cc02bc51a084 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064312 Apr 11 15:21:32 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 31/95] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:21:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:21:32 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:21:32 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-869a8f13-942c-4b37-b8b0-d0567a3f1210 req-08fea766-cad4-48df-ba24-67dffd59c348 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b2c294d-49b2-41bf-89d0-17a560e7741f", "tag": "41b19aaa-a4cf-494a-97e9-c3a081d24d80"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:21:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-869a8f13-942c-4b37-b8b0-d0567a3f1210 req-08fea766-cad4-48df-ba24-67dffd59c348 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-869a8f13-942c-4b37-b8b0-d0567a3f1210 req-08fea766-cad4-48df-ba24-67dffd59c348 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-869a8f13-942c-4b37-b8b0-d0567a3f1210 req-08fea766-cad4-48df-ba24-67dffd59c348 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:32 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-869a8f13-942c-4b37-b8b0-d0567a3f1210 req-08fea766-cad4-48df-ba24-67dffd59c348 service nova] Creating event network-changed:41b19aaa-a4cf-494a-97e9-c3a081d24d80 for instance 2b2c294d-49b2-41bf-89d0-17a560e7741f on user Apr 11 15:21:32 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-869a8f13-942c-4b37-b8b0-d0567a3f1210 req-08fea766-cad4-48df-ba24-67dffd59c348 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035926 Apr 11 15:21:32 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 33/96] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:21:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:21:32 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Flavor limits 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:21:32 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Image limits 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:21:32 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Flavor pref 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:21:32 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Image pref 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:21:32 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:21:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:32 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Getting quotas for project 6abbfac8ab124b919978b9085a958d4b. Resources: {'instances', 'cores', 'ram'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:21:32 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Getting quotas for user dacdf9131d93415596e40cb8a5416137 and project 6abbfac8ab124b919978b9085a958d4b. Resources: {'instances', 'cores', 'ram'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:21:32 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Going to run 1 instances... {{(pid=61165) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:21:32 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52fe638c-5ada-47d5-b376-233bfa808a37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61165) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:21:33 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.680937 Apr 11 15:21:33 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 33/97] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 15:21:32 2023] POST /compute/v2.1/servers => generated 378 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 15:21:33 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-67400cc6-61f9-4f03-96cc-9cd528163675 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:21:33 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-67400cc6-61f9-4f03-96cc-9cd528163675 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:21:33 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-67400cc6-61f9-4f03-96cc-9cd528163675 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dacdf9131d93415596e40cb8a5416137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abbfac8ab124b919978b9085a958d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:21:33 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-67400cc6-61f9-4f03-96cc-9cd528163675 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3bd4e3ea-2df2-48f8-96bd-8f8219c73bea" status: 200 len: 1208 microversion: 2.1 time: 0.129671 Apr 11 15:21:33 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 32/98] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:21:33 2023] GET /compute/v2.1/servers/3bd4e3ea-2df2-48f8-96bd-8f8219c73bea => generated 1208 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:21:35 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-fcd5c44e-73a1-4ddc-91ed-7aa1ceb8ac40 req-35270663-ff6e-4e52-818e-027676c3c332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b2c294d-49b2-41bf-89d0-17a560e7741f", "name": "network-vif-plugged", "status": "completed", "tag": "41b19aaa-a4cf-494a-97e9-c3a081d24d80"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:21:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-fcd5c44e-73a1-4ddc-91ed-7aa1ceb8ac40 req-35270663-ff6e-4e52-818e-027676c3c332 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-fcd5c44e-73a1-4ddc-91ed-7aa1ceb8ac40 req-35270663-ff6e-4e52-818e-027676c3c332 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-fcd5c44e-73a1-4ddc-91ed-7aa1ceb8ac40 req-35270663-ff6e-4e52-818e-027676c3c332 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:35 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=19 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:21:35 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-fcd5c44e-73a1-4ddc-91ed-7aa1ceb8ac40 req-35270663-ff6e-4e52-818e-027676c3c332 service nova] Creating event network-vif-plugged:41b19aaa-a4cf-494a-97e9-c3a081d24d80 for instance 2b2c294d-49b2-41bf-89d0-17a560e7741f on user Apr 11 15:21:35 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-fcd5c44e-73a1-4ddc-91ed-7aa1ceb8ac40 req-35270663-ff6e-4e52-818e-027676c3c332 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052887 Apr 11 15:21:35 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 34/99] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:21:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 15:21:38 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-49f11c86-2207-406c-85e2-1502f28b6fed req-5ab4206a-de5c-4334-ba1e-b307aed4299b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b2c294d-49b2-41bf-89d0-17a560e7741f", "name": "network-vif-plugged", "status": "completed", "tag": "41b19aaa-a4cf-494a-97e9-c3a081d24d80"}, {"name": "network-changed", "server_uuid": "3bd4e3ea-2df2-48f8-96bd-8f8219c73bea", "tag": "6c658c02-f85a-49aa-aaab-5aa3552ddb63"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:21:38 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-49f11c86-2207-406c-85e2-1502f28b6fed req-5ab4206a-de5c-4334-ba1e-b307aed4299b service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:38 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-49f11c86-2207-406c-85e2-1502f28b6fed req-5ab4206a-de5c-4334-ba1e-b307aed4299b service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:38 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-49f11c86-2207-406c-85e2-1502f28b6fed req-5ab4206a-de5c-4334-ba1e-b307aed4299b service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:38 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-49f11c86-2207-406c-85e2-1502f28b6fed req-5ab4206a-de5c-4334-ba1e-b307aed4299b service nova] Creating event network-vif-plugged:41b19aaa-a4cf-494a-97e9-c3a081d24d80 for instance 2b2c294d-49b2-41bf-89d0-17a560e7741f on user Apr 11 15:21:38 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-49f11c86-2207-406c-85e2-1502f28b6fed req-5ab4206a-de5c-4334-ba1e-b307aed4299b service nova] Creating event network-changed:6c658c02-f85a-49aa-aaab-5aa3552ddb63 for instance 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea on user Apr 11 15:21:38 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-49f11c86-2207-406c-85e2-1502f28b6fed req-5ab4206a-de5c-4334-ba1e-b307aed4299b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.057651 Apr 11 15:21:38 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 34/100] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:21:38 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:21:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-442f8dcb-576c-4258-8f08-4bd83c3c9b17 req-c408e4f3-90f8-44ac-85b7-cc5f90e8fc91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bd4e3ea-2df2-48f8-96bd-8f8219c73bea", "name": "network-vif-plugged", "status": "completed", "tag": "6c658c02-f85a-49aa-aaab-5aa3552ddb63"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:21:40 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:21:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-442f8dcb-576c-4258-8f08-4bd83c3c9b17 req-c408e4f3-90f8-44ac-85b7-cc5f90e8fc91 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-442f8dcb-576c-4258-8f08-4bd83c3c9b17 req-c408e4f3-90f8-44ac-85b7-cc5f90e8fc91 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-442f8dcb-576c-4258-8f08-4bd83c3c9b17 req-c408e4f3-90f8-44ac-85b7-cc5f90e8fc91 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:40 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-442f8dcb-576c-4258-8f08-4bd83c3c9b17 req-c408e4f3-90f8-44ac-85b7-cc5f90e8fc91 service nova] Creating event network-vif-plugged:6c658c02-f85a-49aa-aaab-5aa3552ddb63 for instance 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea on user Apr 11 15:21:40 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-442f8dcb-576c-4258-8f08-4bd83c3c9b17 req-c408e4f3-90f8-44ac-85b7-cc5f90e8fc91 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048166 Apr 11 15:21:40 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 33/101] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:21:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:21:42 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=12 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:21:42 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-7cf1a612-2220-4a68-a58d-9ef9998a7811 req-bbd6e30e-eec7-42e0-8ccf-7611af7cfc06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bd4e3ea-2df2-48f8-96bd-8f8219c73bea", "name": "network-vif-plugged", "status": "completed", "tag": "6c658c02-f85a-49aa-aaab-5aa3552ddb63"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:21:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-7cf1a612-2220-4a68-a58d-9ef9998a7811 req-bbd6e30e-eec7-42e0-8ccf-7611af7cfc06 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-7cf1a612-2220-4a68-a58d-9ef9998a7811 req-bbd6e30e-eec7-42e0-8ccf-7611af7cfc06 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-7cf1a612-2220-4a68-a58d-9ef9998a7811 req-bbd6e30e-eec7-42e0-8ccf-7611af7cfc06 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:42 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-7cf1a612-2220-4a68-a58d-9ef9998a7811 req-bbd6e30e-eec7-42e0-8ccf-7611af7cfc06 service nova] Creating event network-vif-plugged:6c658c02-f85a-49aa-aaab-5aa3552ddb63 for instance 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea on user Apr 11 15:21:42 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-7cf1a612-2220-4a68-a58d-9ef9998a7811 req-bbd6e30e-eec7-42e0-8ccf-7611af7cfc06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046736 Apr 11 15:21:42 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 35/102] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:21:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:21:44 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:21:44 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=16 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:21:44 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-bc5995c1-4c81-4820-84ab-0538044c8a16 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:21:44 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-bc5995c1-4c81-4820-84ab-0538044c8a16 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:21:44 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-bc5995c1-4c81-4820-84ab-0538044c8a16 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:44 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-bc5995c1-4c81-4820-84ab-0538044c8a16 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:44 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-bc5995c1-4c81-4820-84ab-0538044c8a16 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:44 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-bc5995c1-4c81-4820-84ab-0538044c8a16 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:44 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-bc5995c1-4c81-4820-84ab-0538044c8a16 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:44 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-bc5995c1-4c81-4820-84ab-0538044c8a16 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:45 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-bc5995c1-4c81-4820-84ab-0538044c8a16 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:21:45 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-bc5995c1-4c81-4820-84ab-0538044c8a16 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:21:45 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-bc5995c1-4c81-4820-84ab-0538044c8a16 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:21:45 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-bc5995c1-4c81-4820-84ab-0538044c8a16 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de1a45fd-27be-4438-80a4-2f3a100643c9" status: 200 len: 1690 microversion: 2.87 time: 0.372290 Apr 11 15:21:45 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 35/103] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:21:44 2023] GET /compute/v2.1/servers/de1a45fd-27be-4438-80a4-2f3a100643c9 => generated 1690 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:21:45 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-725eab7c-4c5e-4c0f-ac09-60a3231d3ed8 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Action: 'create', calling method: .version_select at 0x7f4c2fbe6170>, body: {"keypair": {"name": "tempest-keypair-1831001595", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPnuW6ogctwbnKiG/DdSHSi9VgV3vyQxSlprDZSCcAll42WGSndepoNq81o5lA3ENttdnb+uA8SJzEVin1fvRiPZ5AZG/PDhtEvtRNFaLWWnzYWXpsGmE8Y+m9wccFHrw=="}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:21:45 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=7 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:21:45 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-725eab7c-4c5e-4c0f-ac09-60a3231d3ed8 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Getting quotas for project e64015226c19441d87f3a6999a3a8db8. Resources: {'key_pairs'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:21:45 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-725eab7c-4c5e-4c0f-ac09-60a3231d3ed8 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Getting quotas for user 31d206ed111842fd95ce5eb5b3835a48 and project e64015226c19441d87f3a6999a3a8db8. Resources: {'key_pairs'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:21:45 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-725eab7c-4c5e-4c0f-ac09-60a3231d3ed8 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.045341 Apr 11 15:21:45 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 34/104] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 15:21:45 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 15:21:47 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-68ae28d3-b797-45ca-929b-1ccd33b6e432 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:21:47 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-68ae28d3-b797-45ca-929b-1ccd33b6e432 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:21:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-68ae28d3-b797-45ca-929b-1ccd33b6e432 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-68ae28d3-b797-45ca-929b-1ccd33b6e432 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-68ae28d3-b797-45ca-929b-1ccd33b6e432 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-68ae28d3-b797-45ca-929b-1ccd33b6e432 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-68ae28d3-b797-45ca-929b-1ccd33b6e432 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-68ae28d3-b797-45ca-929b-1ccd33b6e432 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:47 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-68ae28d3-b797-45ca-929b-1ccd33b6e432 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b62270e2c254a888625c7e4491adf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc574e5ba43d43029c450e4fa80ac501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:21:47 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-68ae28d3-b797-45ca-929b-1ccd33b6e432 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/074896e5-8065-4b4a-b61a-653bc67718db" status: 200 len: 1490 microversion: 2.1 time: 0.356177 Apr 11 15:21:47 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 36/105] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:21:47 2023] GET /compute/v2.1/servers/074896e5-8065-4b4a-b61a-653bc67718db => generated 1490 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:21:48 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1171936509", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "f10dfc9b-ad09-4bc9-9240-e6696b8f1b0e"}, {"port": "2ac99ade-56b1-4865-b997-a9f8ef0a760b", "tag": "port-1"}, {"port": "097c3cb1-bc8f-42c3-be49-73d500fdbc39", "tag": "port-2"}, {"uuid": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "tag": "net-1"}, {"uuid": "69cdc817-44c9-4420-acb7-e8aebab58bcf"}, {"uuid": "0065e8ee-5334-4ab3-8c58-6a2e6f9954f2", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "0065e8ee-5334-4ab3-8c58-6a2e6f9954f2", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "25935fb7-f8be-4263-8b3b-42330253644d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "f9255f82-4f06-40f7-8c74-41549e0ae487", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "f8e39010-7dc1-43ac-8b13-222b2f4e824c", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1135159658"}], "key_name": "tempest-keypair-1831001595", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:21:48 user devstack@n-api.service[61165]: DEBUG nova.network.neutron [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] validate_networks() for [('f10dfc9b-ad09-4bc9-9240-e6696b8f1b0e', None, None, None, None, None), (None, None, '2ac99ade-56b1-4865-b997-a9f8ef0a760b', None, None, None), (None, None, '097c3cb1-bc8f-42c3-be49-73d500fdbc39', None, None, None), ('69cdc817-44c9-4420-acb7-e8aebab58bcf', None, None, None, None, None), ('69cdc817-44c9-4420-acb7-e8aebab58bcf', None, None, None, None, None), ('0065e8ee-5334-4ab3-8c58-6a2e6f9954f2', '10.2.2.100', None, None, None, None), ('0065e8ee-5334-4ab3-8c58-6a2e6f9954f2', '10.2.2.200', None, None, None, None)] {{(pid=61165) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:21:51 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Flavor limits 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:21:51 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Image limits 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:21:51 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Flavor pref 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:21:51 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Image pref 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:21:51 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:21:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:51 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=19 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:21:51 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Getting quotas for project e64015226c19441d87f3a6999a3a8db8. Resources: {'instances', 'cores', 'ram'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:21:51 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Getting quotas for user 31d206ed111842fd95ce5eb5b3835a48 and project e64015226c19441d87f3a6999a3a8db8. Resources: {'instances', 'cores', 'ram'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:21:51 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Going to run 1 instances... {{(pid=61165) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:21:51 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='25935fb7-f8be-4263-8b3b-42330253644d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='f9255f82-4f06-40f7-8c74-41549e0ae487',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f8e39010-7dc1-43ac-8b13-222b2f4e824c',volume_size=None,volume_type=None)] {{(pid=61165) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:21:52 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.42 time: 3.775065 Apr 11 15:21:52 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 36/106] 10.0.0.210 () {66 vars in 1266 bytes} [Tue Apr 11 15:21:48 2023] POST /compute/v2.1/servers => generated 404 bytes in 3777 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 15:21:52 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-9001e50b-0153-47da-ad41-d082eb0bfc62 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:21:52 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-9001e50b-0153-47da-ad41-d082eb0bfc62 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:21:52 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=16 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:21:52 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=7 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:21:52 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-9001e50b-0153-47da-ad41-d082eb0bfc62 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d206ed111842fd95ce5eb5b3835a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e64015226c19441d87f3a6999a3a8db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:21:52 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-9001e50b-0153-47da-ad41-d082eb0bfc62 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31d206ed111842fd95ce5eb5b3835a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e64015226c19441d87f3a6999a3a8db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:21:52 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-9001e50b-0153-47da-ad41-d082eb0bfc62 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31d206ed111842fd95ce5eb5b3835a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e64015226c19441d87f3a6999a3a8db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:21:52 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-9001e50b-0153-47da-ad41-d082eb0bfc62 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cda43d26-e2f7-4e86-b850-b914957c9b57" status: 200 len: 1280 microversion: 2.42 time: 0.089136 Apr 11 15:21:52 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 35/107] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:21:52 2023] GET /compute/v2.1/servers/cda43d26-e2f7-4e86-b850-b914957c9b57 => generated 1280 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:21:55 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-a8923f30-2771-4baf-9f2a-576dbd0bce72 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:21:55 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-a8923f30-2771-4baf-9f2a-576dbd0bce72 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:21:55 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=4 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:21:55 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-a8923f30-2771-4baf-9f2a-576dbd0bce72 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:55 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-a8923f30-2771-4baf-9f2a-576dbd0bce72 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:55 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-a8923f30-2771-4baf-9f2a-576dbd0bce72 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:55 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-a8923f30-2771-4baf-9f2a-576dbd0bce72 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:55 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-a8923f30-2771-4baf-9f2a-576dbd0bce72 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:55 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-a8923f30-2771-4baf-9f2a-576dbd0bce72 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:55 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-a8923f30-2771-4baf-9f2a-576dbd0bce72 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:21:55 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-a8923f30-2771-4baf-9f2a-576dbd0bce72 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35" status: 200 len: 1540 microversion: 2.1 time: 0.212137 Apr 11 15:21:55 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 37/108] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:21:55 2023] GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35 => generated 1540 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:21:59 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-bc740b4c-a433-4b79-a504-09da06bb17f6 req-a75a7b3d-1655-45fe-8bd7-f2b4c9708da4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "tag": "ee21c1bf-90da-44fe-b6f2-26132b87c5ed"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:21:59 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:21:59 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-bc740b4c-a433-4b79-a504-09da06bb17f6 req-a75a7b3d-1655-45fe-8bd7-f2b4c9708da4 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:21:59 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-bc740b4c-a433-4b79-a504-09da06bb17f6 req-a75a7b3d-1655-45fe-8bd7-f2b4c9708da4 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:21:59 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-bc740b4c-a433-4b79-a504-09da06bb17f6 req-a75a7b3d-1655-45fe-8bd7-f2b4c9708da4 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:21:59 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-bc740b4c-a433-4b79-a504-09da06bb17f6 req-a75a7b3d-1655-45fe-8bd7-f2b4c9708da4 service nova] Creating event network-changed:ee21c1bf-90da-44fe-b6f2-26132b87c5ed for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:21:59 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-bc740b4c-a433-4b79-a504-09da06bb17f6 req-a75a7b3d-1655-45fe-8bd7-f2b4c9708da4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087971 Apr 11 15:21:59 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 37/109] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:21:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:22:01 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-77f7550d-c067-43dd-be9d-cd2cb56a9124 req-be806f50-4dda-4b67-bae8-e007975359d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "tag": "2ac99ade-56b1-4865-b997-a9f8ef0a760b"}, {"name": "network-changed", "server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "tag": "097c3cb1-bc8f-42c3-be49-73d500fdbc39"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:22:01 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-77f7550d-c067-43dd-be9d-cd2cb56a9124 req-be806f50-4dda-4b67-bae8-e007975359d5 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:01 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-77f7550d-c067-43dd-be9d-cd2cb56a9124 req-be806f50-4dda-4b67-bae8-e007975359d5 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:01 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-77f7550d-c067-43dd-be9d-cd2cb56a9124 req-be806f50-4dda-4b67-bae8-e007975359d5 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:01 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-77f7550d-c067-43dd-be9d-cd2cb56a9124 req-be806f50-4dda-4b67-bae8-e007975359d5 service nova] Creating event network-changed:2ac99ade-56b1-4865-b997-a9f8ef0a760b for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:22:01 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-77f7550d-c067-43dd-be9d-cd2cb56a9124 req-be806f50-4dda-4b67-bae8-e007975359d5 service nova] Creating event network-changed:097c3cb1-bc8f-42c3-be49-73d500fdbc39 for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:22:01 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-77f7550d-c067-43dd-be9d-cd2cb56a9124 req-be806f50-4dda-4b67-bae8-e007975359d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.034137 Apr 11 15:22:01 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 36/110] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:22:01 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:22:03 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-a809975f-ec3f-4a2f-8006-3a7e45f753b7 req-70036aa4-2088-4da3-9dc7-022898b5d388 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "tag": "65d1d6cb-a27f-4eae-822e-459770a9a587"}, {"name": "network-changed", "server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "tag": "d9f2f28e-bb0a-4d1b-a831-e2c493521408"}, {"name": "network-changed", "server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "tag": "6d794bc3-2136-4b88-92e5-4703eb113b6d"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:22:03 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-a809975f-ec3f-4a2f-8006-3a7e45f753b7 req-70036aa4-2088-4da3-9dc7-022898b5d388 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:03 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-a809975f-ec3f-4a2f-8006-3a7e45f753b7 req-70036aa4-2088-4da3-9dc7-022898b5d388 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:03 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-a809975f-ec3f-4a2f-8006-3a7e45f753b7 req-70036aa4-2088-4da3-9dc7-022898b5d388 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:03 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-a809975f-ec3f-4a2f-8006-3a7e45f753b7 req-70036aa4-2088-4da3-9dc7-022898b5d388 service nova] Creating event network-changed:65d1d6cb-a27f-4eae-822e-459770a9a587 for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:22:03 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-a809975f-ec3f-4a2f-8006-3a7e45f753b7 req-70036aa4-2088-4da3-9dc7-022898b5d388 service nova] Creating event network-changed:d9f2f28e-bb0a-4d1b-a831-e2c493521408 for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:22:03 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-a809975f-ec3f-4a2f-8006-3a7e45f753b7 req-70036aa4-2088-4da3-9dc7-022898b5d388 service nova] Creating event network-changed:6d794bc3-2136-4b88-92e5-4703eb113b6d for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:22:03 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-a809975f-ec3f-4a2f-8006-3a7e45f753b7 req-70036aa4-2088-4da3-9dc7-022898b5d388 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.034197 Apr 11 15:22:03 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 38/111] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:22:03 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:22:05 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:22:05 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:22:05 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-69b81280-da17-49ab-967e-3660a81ac904 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:22:05 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-69b81280-da17-49ab-967e-3660a81ac904 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:22:05 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-69b81280-da17-49ab-967e-3660a81ac904 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:05 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-69b81280-da17-49ab-967e-3660a81ac904 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:05 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-69b81280-da17-49ab-967e-3660a81ac904 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:05 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-69b81280-da17-49ab-967e-3660a81ac904 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:05 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-69b81280-da17-49ab-967e-3660a81ac904 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:05 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-69b81280-da17-49ab-967e-3660a81ac904 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:05 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-69b81280-da17-49ab-967e-3660a81ac904 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc44d2042554ca0b0bde4b2de5b566a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a341ccfc0b4f08bb2e97083143dd40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:22:05 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-69b81280-da17-49ab-967e-3660a81ac904 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b1dedd0-ae18-421b-b83a-a7b2c22c65d5" status: 200 len: 1484 microversion: 2.1 time: 0.296776 Apr 11 15:22:05 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 38/112] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:22:05 2023] GET /compute/v2.1/servers/4b1dedd0-ae18-421b-b83a-a7b2c22c65d5 => generated 1484 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:22:05 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:22:05 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-a000a101-5f80-40e1-ab98-83045677a6dd req-88a47cb2-277c-491d-bb4a-79d89280772c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "tag": "e9f0f991-6f64-45e6-9ce7-3f279f5ce31f"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:22:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-a000a101-5f80-40e1-ab98-83045677a6dd req-88a47cb2-277c-491d-bb4a-79d89280772c service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-a000a101-5f80-40e1-ab98-83045677a6dd req-88a47cb2-277c-491d-bb4a-79d89280772c service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-a000a101-5f80-40e1-ab98-83045677a6dd req-88a47cb2-277c-491d-bb4a-79d89280772c service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:05 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-a000a101-5f80-40e1-ab98-83045677a6dd req-88a47cb2-277c-491d-bb4a-79d89280772c service nova] Creating event network-changed:e9f0f991-6f64-45e6-9ce7-3f279f5ce31f for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:22:05 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-a000a101-5f80-40e1-ab98-83045677a6dd req-88a47cb2-277c-491d-bb4a-79d89280772c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031024 Apr 11 15:22:05 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 37/113] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:22:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:22:11 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-73bb342c-f395-4a3d-a672-ae314b5d33fe tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:22:11 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-73bb342c-f395-4a3d-a672-ae314b5d33fe tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:22:11 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-73bb342c-f395-4a3d-a672-ae314b5d33fe tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:11 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-73bb342c-f395-4a3d-a672-ae314b5d33fe tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:11 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-73bb342c-f395-4a3d-a672-ae314b5d33fe tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:11 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-73bb342c-f395-4a3d-a672-ae314b5d33fe tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:11 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-73bb342c-f395-4a3d-a672-ae314b5d33fe tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:11 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-73bb342c-f395-4a3d-a672-ae314b5d33fe tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:11 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-73bb342c-f395-4a3d-a672-ae314b5d33fe tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ec75db561b4fec903a1a391c3d03e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c88bf2782342c8af04195140d6cd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:22:11 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-73bb342c-f395-4a3d-a672-ae314b5d33fe tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d84862f-b710-48b1-9275-93fc799cf1f9" status: 200 len: 1526 microversion: 2.1 time: 0.441237 Apr 11 15:22:11 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 39/114] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:22:11 2023] GET /compute/v2.1/servers/8d84862f-b710-48b1-9275-93fc799cf1f9 => generated 1526 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:22:13 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-d528c19f-88dd-47af-956b-b35900df4d15 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:22:13 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-d528c19f-88dd-47af-956b-b35900df4d15 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:22:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d528c19f-88dd-47af-956b-b35900df4d15 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d528c19f-88dd-47af-956b-b35900df4d15 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d528c19f-88dd-47af-956b-b35900df4d15 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d528c19f-88dd-47af-956b-b35900df4d15 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d528c19f-88dd-47af-956b-b35900df4d15 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d528c19f-88dd-47af-956b-b35900df4d15 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:13 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-d528c19f-88dd-47af-956b-b35900df4d15 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2717e456dcc941899c48c3c973083bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da140971126a4d298ff718275e7a22ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:22:13 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-d528c19f-88dd-47af-956b-b35900df4d15 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3a06747-0f43-4731-87e6-40629c382a6b" status: 200 len: 1544 microversion: 2.1 time: 0.151336 Apr 11 15:22:13 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 39/115] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:22:13 2023] GET /compute/v2.1/servers/f3a06747-0f43-4731-87e6-40629c382a6b => generated 1544 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:22:17 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-5f52a508-7669-42d5-b244-f50061e3ca77 req-2daa47dc-48a7-4115-8917-7ec7a5a89c44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "name": "network-vif-plugged", "status": "completed", "tag": "ee21c1bf-90da-44fe-b6f2-26132b87c5ed"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:22:17 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=7 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:22:17 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:22:17 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-5f52a508-7669-42d5-b244-f50061e3ca77 req-2daa47dc-48a7-4115-8917-7ec7a5a89c44 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:17 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-5f52a508-7669-42d5-b244-f50061e3ca77 req-2daa47dc-48a7-4115-8917-7ec7a5a89c44 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:17 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-5f52a508-7669-42d5-b244-f50061e3ca77 req-2daa47dc-48a7-4115-8917-7ec7a5a89c44 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:17 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-5f52a508-7669-42d5-b244-f50061e3ca77 req-2daa47dc-48a7-4115-8917-7ec7a5a89c44 service nova] Creating event network-vif-plugged:ee21c1bf-90da-44fe-b6f2-26132b87c5ed for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:22:17 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-5f52a508-7669-42d5-b244-f50061e3ca77 req-2daa47dc-48a7-4115-8917-7ec7a5a89c44 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045179 Apr 11 15:22:17 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 38/116] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:22:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:22:17 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-abc5540f-e627-4ee1-8ade-2f36583391c2 req-de4848f5-0acc-4c98-95f5-6c986dca741c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "name": "network-vif-plugged", "status": "completed", "tag": "2ac99ade-56b1-4865-b997-a9f8ef0a760b"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:22:17 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-abc5540f-e627-4ee1-8ade-2f36583391c2 req-de4848f5-0acc-4c98-95f5-6c986dca741c service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:17 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-abc5540f-e627-4ee1-8ade-2f36583391c2 req-de4848f5-0acc-4c98-95f5-6c986dca741c service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:17 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-abc5540f-e627-4ee1-8ade-2f36583391c2 req-de4848f5-0acc-4c98-95f5-6c986dca741c service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:17 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=24 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:22:17 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-abc5540f-e627-4ee1-8ade-2f36583391c2 req-de4848f5-0acc-4c98-95f5-6c986dca741c service nova] Creating event network-vif-plugged:2ac99ade-56b1-4865-b997-a9f8ef0a760b for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:22:17 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-abc5540f-e627-4ee1-8ade-2f36583391c2 req-de4848f5-0acc-4c98-95f5-6c986dca741c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063975 Apr 11 15:22:17 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 40/117] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:22:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:22:18 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-e9719a98-70a1-49d8-af21-dd148743f4be tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:22:18 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-e9719a98-70a1-49d8-af21-dd148743f4be tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:22:18 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e9719a98-70a1-49d8-af21-dd148743f4be tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:18 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e9719a98-70a1-49d8-af21-dd148743f4be tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:18 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e9719a98-70a1-49d8-af21-dd148743f4be tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:18 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e9719a98-70a1-49d8-af21-dd148743f4be tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:18 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e9719a98-70a1-49d8-af21-dd148743f4be tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:18 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e9719a98-70a1-49d8-af21-dd148743f4be tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:18 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-e9719a98-70a1-49d8-af21-dd148743f4be tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab8ba2ebb8643a59d3a8a821cd1c2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67f7203b1849c0af305f88ad8284f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:22:18 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-e9719a98-70a1-49d8-af21-dd148743f4be tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2b2c294d-49b2-41bf-89d0-17a560e7741f" status: 200 len: 1549 microversion: 2.1 time: 0.293026 Apr 11 15:22:18 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 40/118] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:22:18 2023] GET /compute/v2.1/servers/2b2c294d-49b2-41bf-89d0-17a560e7741f => generated 1549 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:22:18 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-0939683e-4d77-4056-b4aa-b8b8359ad882 req-b46a5176-1d60-46ec-bcaf-76d97fc0e946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "name": "network-vif-plugged", "status": "completed", "tag": "6d794bc3-2136-4b88-92e5-4703eb113b6d"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:22:18 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-0939683e-4d77-4056-b4aa-b8b8359ad882 req-b46a5176-1d60-46ec-bcaf-76d97fc0e946 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:18 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-0939683e-4d77-4056-b4aa-b8b8359ad882 req-b46a5176-1d60-46ec-bcaf-76d97fc0e946 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:18 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-0939683e-4d77-4056-b4aa-b8b8359ad882 req-b46a5176-1d60-46ec-bcaf-76d97fc0e946 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:18 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-0939683e-4d77-4056-b4aa-b8b8359ad882 req-b46a5176-1d60-46ec-bcaf-76d97fc0e946 service nova] Creating event network-vif-plugged:6d794bc3-2136-4b88-92e5-4703eb113b6d for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:22:18 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-0939683e-4d77-4056-b4aa-b8b8359ad882 req-b46a5176-1d60-46ec-bcaf-76d97fc0e946 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029935 Apr 11 15:22:18 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 39/119] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:22:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:22:19 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "name": "network-vif-plugged", "status": "completed", "tag": "ee21c1bf-90da-44fe-b6f2-26132b87c5ed"}, {"server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "name": "network-vif-plugged", "status": "completed", "tag": "097c3cb1-bc8f-42c3-be49-73d500fdbc39"}, {"server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "name": "network-vif-plugged", "status": "completed", "tag": "097c3cb1-bc8f-42c3-be49-73d500fdbc39"}, {"server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "name": "network-vif-plugged", "status": "completed", "tag": "d9f2f28e-bb0a-4d1b-a831-e2c493521408"}, {"server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "name": "network-vif-plugged", "status": "completed", "tag": "d9f2f28e-bb0a-4d1b-a831-e2c493521408"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:22:19 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:19 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:19 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:19 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] Creating event network-vif-plugged:ee21c1bf-90da-44fe-b6f2-26132b87c5ed for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:22:19 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] Creating event network-vif-plugged:097c3cb1-bc8f-42c3-be49-73d500fdbc39 for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:22:19 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] Creating event network-vif-plugged:097c3cb1-bc8f-42c3-be49-73d500fdbc39 for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:22:19 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] Creating event network-vif-plugged:d9f2f28e-bb0a-4d1b-a831-e2c493521408 for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:22:19 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] Creating event network-vif-plugged:d9f2f28e-bb0a-4d1b-a831-e2c493521408 for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:22:19 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.042090 Apr 11 15:22:19 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 41/120] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:22:19 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:22:19 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-2b222a61-820b-47eb-acda-42e940e0f1fc req-b77c2cf9-1321-4c4b-89c2-5750e6792d55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "name": "network-vif-plugged", "status": "completed", "tag": "2ac99ade-56b1-4865-b997-a9f8ef0a760b"}, {"server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "name": "network-vif-plugged", "status": "completed", "tag": "65d1d6cb-a27f-4eae-822e-459770a9a587"}, {"server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "name": "network-vif-plugged", "status": "completed", "tag": "65d1d6cb-a27f-4eae-822e-459770a9a587"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:22:19 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-2b222a61-820b-47eb-acda-42e940e0f1fc req-b77c2cf9-1321-4c4b-89c2-5750e6792d55 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:19 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-2b222a61-820b-47eb-acda-42e940e0f1fc req-b77c2cf9-1321-4c4b-89c2-5750e6792d55 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:19 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-2b222a61-820b-47eb-acda-42e940e0f1fc req-b77c2cf9-1321-4c4b-89c2-5750e6792d55 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:19 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-2b222a61-820b-47eb-acda-42e940e0f1fc req-b77c2cf9-1321-4c4b-89c2-5750e6792d55 service nova] Creating event network-vif-plugged:2ac99ade-56b1-4865-b997-a9f8ef0a760b for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:22:19 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-2b222a61-820b-47eb-acda-42e940e0f1fc req-b77c2cf9-1321-4c4b-89c2-5750e6792d55 service nova] Creating event network-vif-plugged:65d1d6cb-a27f-4eae-822e-459770a9a587 for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:22:19 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-2b222a61-820b-47eb-acda-42e940e0f1fc req-b77c2cf9-1321-4c4b-89c2-5750e6792d55 service nova] Creating event network-vif-plugged:65d1d6cb-a27f-4eae-822e-459770a9a587 for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:22:19 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-2b222a61-820b-47eb-acda-42e940e0f1fc req-b77c2cf9-1321-4c4b-89c2-5750e6792d55 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.029796 Apr 11 15:22:19 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 41/121] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:22:19 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:22:20 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-3f21a548-d9d8-498d-9a25-c1816084d65d req-11193f1d-4ffc-4dea-b91f-f17ebc8a2d9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "name": "network-vif-plugged", "status": "completed", "tag": "6d794bc3-2136-4b88-92e5-4703eb113b6d"}, {"server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "name": "network-vif-plugged", "status": "completed", "tag": "e9f0f991-6f64-45e6-9ce7-3f279f5ce31f"}, {"server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "name": "network-vif-plugged", "status": "completed", "tag": "e9f0f991-6f64-45e6-9ce7-3f279f5ce31f"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:22:20 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-3f21a548-d9d8-498d-9a25-c1816084d65d req-11193f1d-4ffc-4dea-b91f-f17ebc8a2d9a service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:20 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-3f21a548-d9d8-498d-9a25-c1816084d65d req-11193f1d-4ffc-4dea-b91f-f17ebc8a2d9a service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:20 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-3f21a548-d9d8-498d-9a25-c1816084d65d req-11193f1d-4ffc-4dea-b91f-f17ebc8a2d9a service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:20 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-3f21a548-d9d8-498d-9a25-c1816084d65d req-11193f1d-4ffc-4dea-b91f-f17ebc8a2d9a service nova] Creating event network-vif-plugged:6d794bc3-2136-4b88-92e5-4703eb113b6d for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:22:20 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-3f21a548-d9d8-498d-9a25-c1816084d65d req-11193f1d-4ffc-4dea-b91f-f17ebc8a2d9a service nova] Creating event network-vif-plugged:e9f0f991-6f64-45e6-9ce7-3f279f5ce31f for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:22:20 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-3f21a548-d9d8-498d-9a25-c1816084d65d req-11193f1d-4ffc-4dea-b91f-f17ebc8a2d9a service nova] Creating event network-vif-plugged:e9f0f991-6f64-45e6-9ce7-3f279f5ce31f for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:22:20 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-3f21a548-d9d8-498d-9a25-c1816084d65d req-11193f1d-4ffc-4dea-b91f-f17ebc8a2d9a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.041987 Apr 11 15:22:20 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 40/122] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:22:20 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:22:23 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-52e9b622-1fc6-4e72-bdd8-6fc94f673f35 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:22:23 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-52e9b622-1fc6-4e72-bdd8-6fc94f673f35 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:22:23 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-52e9b622-1fc6-4e72-bdd8-6fc94f673f35 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:23 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-52e9b622-1fc6-4e72-bdd8-6fc94f673f35 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:23 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-52e9b622-1fc6-4e72-bdd8-6fc94f673f35 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:23 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-52e9b622-1fc6-4e72-bdd8-6fc94f673f35 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:23 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-52e9b622-1fc6-4e72-bdd8-6fc94f673f35 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:23 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-52e9b622-1fc6-4e72-bdd8-6fc94f673f35 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:23 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-52e9b622-1fc6-4e72-bdd8-6fc94f673f35 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dacdf9131d93415596e40cb8a5416137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abbfac8ab124b919978b9085a958d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:22:23 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-52e9b622-1fc6-4e72-bdd8-6fc94f673f35 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3bd4e3ea-2df2-48f8-96bd-8f8219c73bea" status: 200 len: 1453 microversion: 2.1 time: 0.197268 Apr 11 15:22:23 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 42/123] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:22:23 2023] GET /compute/v2.1/servers/3bd4e3ea-2df2-48f8-96bd-8f8219c73bea => generated 1453 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:22:42 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=9 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:22:42 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=23 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:22:42 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-e5a33de3-2f02-440d-8732-f5fa17266ec2 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:22:42 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-e5a33de3-2f02-440d-8732-f5fa17266ec2 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:22:42 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e5a33de3-2f02-440d-8732-f5fa17266ec2 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:42 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e5a33de3-2f02-440d-8732-f5fa17266ec2 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:42 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e5a33de3-2f02-440d-8732-f5fa17266ec2 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:42 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e5a33de3-2f02-440d-8732-f5fa17266ec2 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:42 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e5a33de3-2f02-440d-8732-f5fa17266ec2 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:42 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e5a33de3-2f02-440d-8732-f5fa17266ec2 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:43 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-e5a33de3-2f02-440d-8732-f5fa17266ec2 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d206ed111842fd95ce5eb5b3835a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e64015226c19441d87f3a6999a3a8db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:22:43 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-e5a33de3-2f02-440d-8732-f5fa17266ec2 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31d206ed111842fd95ce5eb5b3835a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e64015226c19441d87f3a6999a3a8db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:22:43 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-e5a33de3-2f02-440d-8732-f5fa17266ec2 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31d206ed111842fd95ce5eb5b3835a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e64015226c19441d87f3a6999a3a8db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:22:43 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-e5a33de3-2f02-440d-8732-f5fa17266ec2 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cda43d26-e2f7-4e86-b850-b914957c9b57" status: 200 len: 2828 microversion: 2.42 time: 0.541289 Apr 11 15:22:43 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 42/124] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:22:42 2023] GET /compute/v2.1/servers/cda43d26-e2f7-4e86-b850-b914957c9b57 => generated 2828 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:22:45 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:22:45 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:22:45 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-801039d5-7103-4778-bd15-2a440ea59524 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1491747236"}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:22:45 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-801039d5-7103-4778-bd15-2a440ea59524 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:22:45 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-801039d5-7103-4778-bd15-2a440ea59524 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:45 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-801039d5-7103-4778-bd15-2a440ea59524 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:45 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-801039d5-7103-4778-bd15-2a440ea59524 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:45 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-801039d5-7103-4778-bd15-2a440ea59524 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:45 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-801039d5-7103-4778-bd15-2a440ea59524 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:45 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-801039d5-7103-4778-bd15-2a440ea59524 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:46 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-801039d5-7103-4778-bd15-2a440ea59524 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "POST /compute/v2.1/servers/de1a45fd-27be-4438-80a4-2f3a100643c9/action" status: 202 len: 52 microversion: 2.87 time: 1.200481 Apr 11 15:22:46 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 41/125] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 15:22:45 2023] POST /compute/v2.1/servers/de1a45fd-27be-4438-80a4-2f3a100643c9/action => generated 52 bytes in 1202 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 11 15:22:49 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aef9b013-1588-4f60-9f42-59ac8ed9c42a"}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:22:49 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:22:49 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=11 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:22:49 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=9 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:22:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:49 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] 10.0.0.210 "POST /compute/v2.1/servers/074896e5-8065-4b4a-b61a-653bc67718db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.496558 Apr 11 15:22:49 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 43/126] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 15:22:49 2023] POST /compute/v2.1/servers/074896e5-8065-4b4a-b61a-653bc67718db/os-volume_attachments => generated 194 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:22:51 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-b7e80cf8-a7ad-43ce-b201-6c8032afe0ad tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:22:51 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-b7e80cf8-a7ad-43ce-b201-6c8032afe0ad tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:22:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b7e80cf8-a7ad-43ce-b201-6c8032afe0ad tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b7e80cf8-a7ad-43ce-b201-6c8032afe0ad tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b7e80cf8-a7ad-43ce-b201-6c8032afe0ad tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b7e80cf8-a7ad-43ce-b201-6c8032afe0ad tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b7e80cf8-a7ad-43ce-b201-6c8032afe0ad tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b7e80cf8-a7ad-43ce-b201-6c8032afe0ad tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:51 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-b7e80cf8-a7ad-43ce-b201-6c8032afe0ad tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:22:51 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-b7e80cf8-a7ad-43ce-b201-6c8032afe0ad tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:22:51 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-b7e80cf8-a7ad-43ce-b201-6c8032afe0ad tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:22:51 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-b7e80cf8-a7ad-43ce-b201-6c8032afe0ad tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de1a45fd-27be-4438-80a4-2f3a100643c9" status: 200 len: 1690 microversion: 2.87 time: 0.147671 Apr 11 15:22:51 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 43/127] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:22:51 2023] GET /compute/v2.1/servers/de1a45fd-27be-4438-80a4-2f3a100643c9 => generated 1690 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:22:55 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:22:55 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-f804f928-db0f-4785-a32f-d30b232f85ea tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:22:55 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-f804f928-db0f-4785-a32f-d30b232f85ea tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:22:55 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f804f928-db0f-4785-a32f-d30b232f85ea tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:55 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f804f928-db0f-4785-a32f-d30b232f85ea tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:55 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f804f928-db0f-4785-a32f-d30b232f85ea tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:55 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f804f928-db0f-4785-a32f-d30b232f85ea tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:55 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f804f928-db0f-4785-a32f-d30b232f85ea tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:55 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f804f928-db0f-4785-a32f-d30b232f85ea tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:55 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-f804f928-db0f-4785-a32f-d30b232f85ea tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.094440 Apr 11 15:22:55 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 42/128] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 15:22:55 2023] GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35/os-interface => generated 283 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 15:22:56 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-07f23c31-602b-4ae6-8c2b-98ae2e1c456e req-bcedfa2a-6291-4b49-abb7-7ddf541733a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a805345-374c-4326-9e8f-39bfc7947a35", "tag": "d8c64197-b034-4f38-821d-ba030f1fca6b"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:22:56 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-07f23c31-602b-4ae6-8c2b-98ae2e1c456e req-bcedfa2a-6291-4b49-abb7-7ddf541733a9 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:56 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-07f23c31-602b-4ae6-8c2b-98ae2e1c456e req-bcedfa2a-6291-4b49-abb7-7ddf541733a9 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:56 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-07f23c31-602b-4ae6-8c2b-98ae2e1c456e req-bcedfa2a-6291-4b49-abb7-7ddf541733a9 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:56 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-07f23c31-602b-4ae6-8c2b-98ae2e1c456e req-bcedfa2a-6291-4b49-abb7-7ddf541733a9 service nova] Creating event network-changed:d8c64197-b034-4f38-821d-ba030f1fca6b for instance 6a805345-374c-4326-9e8f-39bfc7947a35 on user Apr 11 15:22:56 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-07f23c31-602b-4ae6-8c2b-98ae2e1c456e req-bcedfa2a-6291-4b49-abb7-7ddf541733a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035771 Apr 11 15:22:56 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 44/129] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:22:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:22:56 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-999f60ad-959a-4382-b8de-b3fe0977913a tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:22:56 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-999f60ad-959a-4382-b8de-b3fe0977913a tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:22:56 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-999f60ad-959a-4382-b8de-b3fe0977913a tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:56 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-999f60ad-959a-4382-b8de-b3fe0977913a tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:56 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-999f60ad-959a-4382-b8de-b3fe0977913a tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:56 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-999f60ad-959a-4382-b8de-b3fe0977913a tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:56 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-999f60ad-959a-4382-b8de-b3fe0977913a tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:56 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-999f60ad-959a-4382-b8de-b3fe0977913a tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:57 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-999f60ad-959a-4382-b8de-b3fe0977913a tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:22:57 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-999f60ad-959a-4382-b8de-b3fe0977913a tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35" status: 200 len: 1540 microversion: 2.1 time: 0.225276 Apr 11 15:22:57 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 44/130] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:22:56 2023] GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35 => generated 1540 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:22:57 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-d9c5dadf-6b1b-4021-a99c-7617de235a15 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:22:57 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-d9c5dadf-6b1b-4021-a99c-7617de235a15 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:22:57 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d9c5dadf-6b1b-4021-a99c-7617de235a15 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:57 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d9c5dadf-6b1b-4021-a99c-7617de235a15 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:57 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d9c5dadf-6b1b-4021-a99c-7617de235a15 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:57 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d9c5dadf-6b1b-4021-a99c-7617de235a15 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:57 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d9c5dadf-6b1b-4021-a99c-7617de235a15 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:57 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d9c5dadf-6b1b-4021-a99c-7617de235a15 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:57 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-d9c5dadf-6b1b-4021-a99c-7617de235a15 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:22:57 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-d9c5dadf-6b1b-4021-a99c-7617de235a15 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35" status: 200 len: 1540 microversion: 2.1 time: 0.249146 Apr 11 15:22:57 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 43/131] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:22:57 2023] GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35 => generated 1540 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:22:57 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:22:57 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:22:57 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:57 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:57 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:57 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:57 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:57 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:57 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Going to try to terminate instance {{(pid=61167) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:22:57 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/074896e5-8065-4b4a-b61a-653bc67718db" status: 204 len: 0 microversion: 2.1 time: 0.146420 Apr 11 15:22:57 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 45/132] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:22:57 2023] DELETE /compute/v2.1/servers/074896e5-8065-4b4a-b61a-653bc67718db => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:22:57 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-550ef729-3acc-4b8c-a4f2-1964b525c69a tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:22:57 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-550ef729-3acc-4b8c-a4f2-1964b525c69a tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:22:57 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-550ef729-3acc-4b8c-a4f2-1964b525c69a tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:57 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-550ef729-3acc-4b8c-a4f2-1964b525c69a tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:57 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-550ef729-3acc-4b8c-a4f2-1964b525c69a tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:57 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-550ef729-3acc-4b8c-a4f2-1964b525c69a tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:57 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-550ef729-3acc-4b8c-a4f2-1964b525c69a tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:57 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-550ef729-3acc-4b8c-a4f2-1964b525c69a tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:57 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-550ef729-3acc-4b8c-a4f2-1964b525c69a tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b62270e2c254a888625c7e4491adf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc574e5ba43d43029c450e4fa80ac501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:22:57 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-550ef729-3acc-4b8c-a4f2-1964b525c69a tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/074896e5-8065-4b4a-b61a-653bc67718db" status: 200 len: 1542 microversion: 2.1 time: 0.164421 Apr 11 15:22:57 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 45/133] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:22:57 2023] GET /compute/v2.1/servers/074896e5-8065-4b4a-b61a-653bc67718db => generated 1542 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:22:58 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-c19c202e-8f1f-4831-99c0-4552be2993a7 req-39075bf4-cea3-479c-af92-6a828d6187a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "074896e5-8065-4b4a-b61a-653bc67718db", "name": "network-vif-unplugged", "status": "completed", "tag": "b0a1c8e2-240f-45dc-bfcc-24902144caf8"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:22:58 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-c19c202e-8f1f-4831-99c0-4552be2993a7 req-39075bf4-cea3-479c-af92-6a828d6187a9 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:58 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-c19c202e-8f1f-4831-99c0-4552be2993a7 req-39075bf4-cea3-479c-af92-6a828d6187a9 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:58 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-c19c202e-8f1f-4831-99c0-4552be2993a7 req-39075bf4-cea3-479c-af92-6a828d6187a9 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:58 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-c19c202e-8f1f-4831-99c0-4552be2993a7 req-39075bf4-cea3-479c-af92-6a828d6187a9 service nova] Creating event network-vif-unplugged:b0a1c8e2-240f-45dc-bfcc-24902144caf8 for instance 074896e5-8065-4b4a-b61a-653bc67718db on user Apr 11 15:22:58 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-c19c202e-8f1f-4831-99c0-4552be2993a7 req-39075bf4-cea3-479c-af92-6a828d6187a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032927 Apr 11 15:22:58 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 44/134] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:22:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:22:59 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-f0edf0fb-e1e4-468a-bc89-96ec28b9ca07 req-5de72873-c3cb-42d4-8995-21d99839fb09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "074896e5-8065-4b4a-b61a-653bc67718db", "name": "network-vif-deleted", "tag": "b0a1c8e2-240f-45dc-bfcc-24902144caf8"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:22:59 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-f0edf0fb-e1e4-468a-bc89-96ec28b9ca07 req-5de72873-c3cb-42d4-8995-21d99839fb09 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:22:59 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-f0edf0fb-e1e4-468a-bc89-96ec28b9ca07 req-5de72873-c3cb-42d4-8995-21d99839fb09 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:22:59 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-f0edf0fb-e1e4-468a-bc89-96ec28b9ca07 req-5de72873-c3cb-42d4-8995-21d99839fb09 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:22:59 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-f0edf0fb-e1e4-468a-bc89-96ec28b9ca07 req-5de72873-c3cb-42d4-8995-21d99839fb09 service nova] Creating event network-vif-deleted:b0a1c8e2-240f-45dc-bfcc-24902144caf8 for instance 074896e5-8065-4b4a-b61a-653bc67718db on user Apr 11 15:22:59 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-f0edf0fb-e1e4-468a-bc89-96ec28b9ca07 req-5de72873-c3cb-42d4-8995-21d99839fb09 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032655 Apr 11 15:22:59 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 46/135] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:22:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:23:00 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-a29f4e44-911f-4afe-8435-7371584fe81e req-51070967-ac1c-4d16-8657-8798cae55272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "074896e5-8065-4b4a-b61a-653bc67718db", "name": "network-vif-plugged", "status": "completed", "tag": "b0a1c8e2-240f-45dc-bfcc-24902144caf8"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:23:00 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-a29f4e44-911f-4afe-8435-7371584fe81e req-51070967-ac1c-4d16-8657-8798cae55272 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:00 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-a29f4e44-911f-4afe-8435-7371584fe81e req-51070967-ac1c-4d16-8657-8798cae55272 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:00 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-a29f4e44-911f-4afe-8435-7371584fe81e req-51070967-ac1c-4d16-8657-8798cae55272 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:00 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-a29f4e44-911f-4afe-8435-7371584fe81e req-51070967-ac1c-4d16-8657-8798cae55272 service nova] Creating event network-vif-plugged:b0a1c8e2-240f-45dc-bfcc-24902144caf8 for instance 074896e5-8065-4b4a-b61a-653bc67718db on user Apr 11 15:23:00 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-a29f4e44-911f-4afe-8435-7371584fe81e req-51070967-ac1c-4d16-8657-8798cae55272 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029425 Apr 11 15:23:00 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 46/136] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:23:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 15:23:05 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:05 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:05 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Going to try to terminate instance {{(pid=61166) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:23:06 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4b1dedd0-ae18-421b-b83a-a7b2c22c65d5" status: 204 len: 0 microversion: 2.1 time: 0.119073 Apr 11 15:23:06 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 45/137] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:23:05 2023] DELETE /compute/v2.1/servers/4b1dedd0-ae18-421b-b83a-a7b2c22c65d5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:23:06 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-67ac9e91-6d2c-433a-97fc-0a2f369d9996 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:06 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-67ac9e91-6d2c-433a-97fc-0a2f369d9996 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:06 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-67ac9e91-6d2c-433a-97fc-0a2f369d9996 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:06 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-67ac9e91-6d2c-433a-97fc-0a2f369d9996 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:06 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-67ac9e91-6d2c-433a-97fc-0a2f369d9996 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:06 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-67ac9e91-6d2c-433a-97fc-0a2f369d9996 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:06 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-67ac9e91-6d2c-433a-97fc-0a2f369d9996 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:06 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-67ac9e91-6d2c-433a-97fc-0a2f369d9996 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:06 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-67ac9e91-6d2c-433a-97fc-0a2f369d9996 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc44d2042554ca0b0bde4b2de5b566a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a341ccfc0b4f08bb2e97083143dd40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:23:06 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-67ac9e91-6d2c-433a-97fc-0a2f369d9996 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b1dedd0-ae18-421b-b83a-a7b2c22c65d5" status: 200 len: 1490 microversion: 2.1 time: 0.296080 Apr 11 15:23:06 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 47/138] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:23:06 2023] GET /compute/v2.1/servers/4b1dedd0-ae18-421b-b83a-a7b2c22c65d5 => generated 1490 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:23:06 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-f111dffd-3c34-4f2b-b0a3-038d07e22bd6 req-2f9387f0-4ad4-472b-9c42-3c3c9a9cd9c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b1dedd0-ae18-421b-b83a-a7b2c22c65d5", "name": "network-vif-unplugged", "status": "completed", "tag": "e92694db-c1b5-4366-bf78-1f6340cab2fe"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:23:06 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-f111dffd-3c34-4f2b-b0a3-038d07e22bd6 req-2f9387f0-4ad4-472b-9c42-3c3c9a9cd9c8 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:06 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-f111dffd-3c34-4f2b-b0a3-038d07e22bd6 req-2f9387f0-4ad4-472b-9c42-3c3c9a9cd9c8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:06 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-f111dffd-3c34-4f2b-b0a3-038d07e22bd6 req-2f9387f0-4ad4-472b-9c42-3c3c9a9cd9c8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:06 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-f111dffd-3c34-4f2b-b0a3-038d07e22bd6 req-2f9387f0-4ad4-472b-9c42-3c3c9a9cd9c8 service nova] Creating event network-vif-unplugged:e92694db-c1b5-4366-bf78-1f6340cab2fe for instance 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5 on user Apr 11 15:23:06 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-f111dffd-3c34-4f2b-b0a3-038d07e22bd6 req-2f9387f0-4ad4-472b-9c42-3c3c9a9cd9c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125364 Apr 11 15:23:06 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 47/139] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:23:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:23:08 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-82f02e7f-63c4-4d5b-bb2c-62e6e6ca342b req-90506a1f-0071-4caa-996f-6b2548f6e77e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b1dedd0-ae18-421b-b83a-a7b2c22c65d5", "name": "network-vif-plugged", "status": "completed", "tag": "e92694db-c1b5-4366-bf78-1f6340cab2fe"}, {"server_uuid": "4b1dedd0-ae18-421b-b83a-a7b2c22c65d5", "name": "network-vif-deleted", "tag": "e92694db-c1b5-4366-bf78-1f6340cab2fe"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:23:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-82f02e7f-63c4-4d5b-bb2c-62e6e6ca342b req-90506a1f-0071-4caa-996f-6b2548f6e77e service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-82f02e7f-63c4-4d5b-bb2c-62e6e6ca342b req-90506a1f-0071-4caa-996f-6b2548f6e77e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-82f02e7f-63c4-4d5b-bb2c-62e6e6ca342b req-90506a1f-0071-4caa-996f-6b2548f6e77e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:08 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-82f02e7f-63c4-4d5b-bb2c-62e6e6ca342b req-90506a1f-0071-4caa-996f-6b2548f6e77e service nova] Creating event network-vif-plugged:e92694db-c1b5-4366-bf78-1f6340cab2fe for instance 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5 on user Apr 11 15:23:08 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-82f02e7f-63c4-4d5b-bb2c-62e6e6ca342b req-90506a1f-0071-4caa-996f-6b2548f6e77e service nova] Creating event network-vif-deleted:e92694db-c1b5-4366-bf78-1f6340cab2fe for instance 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5 on user Apr 11 15:23:08 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-82f02e7f-63c4-4d5b-bb2c-62e6e6ca342b req-90506a1f-0071-4caa-996f-6b2548f6e77e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030800 Apr 11 15:23:08 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 46/140] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:23:08 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 15:23:11 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-1b17a0fa-2ed1-405d-8952-8bbbfaba97da tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:11 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-1b17a0fa-2ed1-405d-8952-8bbbfaba97da tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:11 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1b17a0fa-2ed1-405d-8952-8bbbfaba97da tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:11 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1b17a0fa-2ed1-405d-8952-8bbbfaba97da tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:11 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1b17a0fa-2ed1-405d-8952-8bbbfaba97da tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:11 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1b17a0fa-2ed1-405d-8952-8bbbfaba97da tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:11 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1b17a0fa-2ed1-405d-8952-8bbbfaba97da tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:11 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1b17a0fa-2ed1-405d-8952-8bbbfaba97da tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:12 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-1b17a0fa-2ed1-405d-8952-8bbbfaba97da tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d84862f-b710-48b1-9275-93fc799cf1f9/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.102800 Apr 11 15:23:12 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 48/141] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 15:23:11 2023] GET /compute/v2.1/servers/8d84862f-b710-48b1-9275-93fc799cf1f9/os-interface => generated 283 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:23:13 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-da79c7db-e943-4380-9111-ecbc41030b06 req-072c97af-5fe6-4d2b-8489-de5afb31252e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d84862f-b710-48b1-9275-93fc799cf1f9", "tag": "bcba48c0-9931-4249-925c-57cb387499d1"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:23:13 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=15 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:23:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-da79c7db-e943-4380-9111-ecbc41030b06 req-072c97af-5fe6-4d2b-8489-de5afb31252e service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-da79c7db-e943-4380-9111-ecbc41030b06 req-072c97af-5fe6-4d2b-8489-de5afb31252e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-da79c7db-e943-4380-9111-ecbc41030b06 req-072c97af-5fe6-4d2b-8489-de5afb31252e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:13 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=29 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:23:13 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-da79c7db-e943-4380-9111-ecbc41030b06 req-072c97af-5fe6-4d2b-8489-de5afb31252e service nova] Creating event network-changed:bcba48c0-9931-4249-925c-57cb387499d1 for instance 8d84862f-b710-48b1-9275-93fc799cf1f9 on user Apr 11 15:23:13 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-da79c7db-e943-4380-9111-ecbc41030b06 req-072c97af-5fe6-4d2b-8489-de5afb31252e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040159 Apr 11 15:23:13 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 48/142] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:23:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:23:13 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-8cde9059-948c-4b7e-afb2-7030693c1947 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:13 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-8cde9059-948c-4b7e-afb2-7030693c1947 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8cde9059-948c-4b7e-afb2-7030693c1947 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8cde9059-948c-4b7e-afb2-7030693c1947 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8cde9059-948c-4b7e-afb2-7030693c1947 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8cde9059-948c-4b7e-afb2-7030693c1947 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8cde9059-948c-4b7e-afb2-7030693c1947 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8cde9059-948c-4b7e-afb2-7030693c1947 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:13 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "761a1221-3eec-47f9-8a05-9eb545bede26"}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:23:13 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:13 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:13 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:13 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:13 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:13 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:13 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:13 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-8cde9059-948c-4b7e-afb2-7030693c1947 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3a06747-0f43-4731-87e6-40629c382a6b/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.140270 Apr 11 15:23:13 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 47/143] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 15:23:13 2023] GET /compute/v2.1/servers/f3a06747-0f43-4731-87e6-40629c382a6b/os-interface => generated 282 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:23:13 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8d84862f-b710-48b1-9275-93fc799cf1f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.334698 Apr 11 15:23:13 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 49/144] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 15:23:13 2023] POST /compute/v2.1/servers/8d84862f-b710-48b1-9275-93fc799cf1f9/os-volume_attachments => generated 194 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:23:14 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-63f50f52-8939-463c-aeaf-04d3ba064ddf req-bf233dc4-af22-4f93-86d2-76351bd8ea70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3a06747-0f43-4731-87e6-40629c382a6b", "tag": "a7049f98-5ea1-4167-be7f-3206830f17c4"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:23:14 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-63f50f52-8939-463c-aeaf-04d3ba064ddf req-bf233dc4-af22-4f93-86d2-76351bd8ea70 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:14 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-63f50f52-8939-463c-aeaf-04d3ba064ddf req-bf233dc4-af22-4f93-86d2-76351bd8ea70 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:14 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-63f50f52-8939-463c-aeaf-04d3ba064ddf req-bf233dc4-af22-4f93-86d2-76351bd8ea70 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:14 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-63f50f52-8939-463c-aeaf-04d3ba064ddf req-bf233dc4-af22-4f93-86d2-76351bd8ea70 service nova] Creating event network-changed:a7049f98-5ea1-4167-be7f-3206830f17c4 for instance f3a06747-0f43-4731-87e6-40629c382a6b on user Apr 11 15:23:14 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-63f50f52-8939-463c-aeaf-04d3ba064ddf req-bf233dc4-af22-4f93-86d2-76351bd8ea70 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041117 Apr 11 15:23:14 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 49/145] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:23:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:23:15 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63216764-be19-490d-a6be-b93ad54a8762"}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:23:15 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:15 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:23:16 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f3a06747-0f43-4731-87e6-40629c382a6b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306519 Apr 11 15:23:16 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 48/146] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 15:23:15 2023] POST /compute/v2.1/servers/f3a06747-0f43-4731-87e6-40629c382a6b/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:23:18 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-9063151c-a6a7-4371-9482-df1279631e36 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:18 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-9063151c-a6a7-4371-9482-df1279631e36 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-9063151c-a6a7-4371-9482-df1279631e36 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-9063151c-a6a7-4371-9482-df1279631e36 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-9063151c-a6a7-4371-9482-df1279631e36 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-9063151c-a6a7-4371-9482-df1279631e36 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-9063151c-a6a7-4371-9482-df1279631e36 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-9063151c-a6a7-4371-9482-df1279631e36 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:18 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-9063151c-a6a7-4371-9482-df1279631e36 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2b2c294d-49b2-41bf-89d0-17a560e7741f/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.089071 Apr 11 15:23:18 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 50/147] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 15:23:18 2023] GET /compute/v2.1/servers/2b2c294d-49b2-41bf-89d0-17a560e7741f/os-interface => generated 283 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:23:19 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-c58df0a4-2531-44df-929f-0c983e087e5f req-009da4e0-6574-4f22-8a98-bdbdc2caaa74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b2c294d-49b2-41bf-89d0-17a560e7741f", "tag": "41b19aaa-a4cf-494a-97e9-c3a081d24d80"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:23:19 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-c58df0a4-2531-44df-929f-0c983e087e5f req-009da4e0-6574-4f22-8a98-bdbdc2caaa74 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:19 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-c58df0a4-2531-44df-929f-0c983e087e5f req-009da4e0-6574-4f22-8a98-bdbdc2caaa74 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:19 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-c58df0a4-2531-44df-929f-0c983e087e5f req-009da4e0-6574-4f22-8a98-bdbdc2caaa74 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:19 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-c58df0a4-2531-44df-929f-0c983e087e5f req-009da4e0-6574-4f22-8a98-bdbdc2caaa74 service nova] Creating event network-changed:41b19aaa-a4cf-494a-97e9-c3a081d24d80 for instance 2b2c294d-49b2-41bf-89d0-17a560e7741f on user Apr 11 15:23:19 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-c58df0a4-2531-44df-929f-0c983e087e5f req-009da4e0-6574-4f22-8a98-bdbdc2caaa74 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042809 Apr 11 15:23:19 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 50/148] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:23:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:23:20 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "33e46e47-d157-4f4d-b7cf-96f42888f78c"}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:23:20 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:20 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:20 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:20 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:20 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:20 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:20 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:20 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/8d84862f-b710-48b1-9275-93fc799cf1f9/os-volume_attachments/761a1221-3eec-47f9-8a05-9eb545bede26" status: 202 len: 0 microversion: 2.1 time: 0.615859 Apr 11 15:23:20 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 49/149] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Apr 11 15:23:20 2023] PUT /compute/v2.1/servers/8d84862f-b710-48b1-9275-93fc799cf1f9/os-volume_attachments/761a1221-3eec-47f9-8a05-9eb545bede26 => generated 0 bytes in 618 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:23:21 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1eaab93-85f1-49cd-a6c4-4c499c77d2c9"}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:23:21 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:21 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:23:21 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:21 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:21 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:21 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:21 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:21 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:21 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:23:21 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2b2c294d-49b2-41bf-89d0-17a560e7741f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.428638 Apr 11 15:23:21 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 51/150] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 15:23:21 2023] POST /compute/v2.1/servers/2b2c294d-49b2-41bf-89d0-17a560e7741f/os-volume_attachments => generated 194 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:23:22 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-062f69e4-9a76-413e-b7c3-f3a2ef3bb4cc tempest-VolumesAdminNegativeTest-1731188693 tempest-VolumesAdminNegativeTest-1731188693-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "af46f4cf-086a-4976-b2d0-e0648e716121"}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:23:22 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-062f69e4-9a76-413e-b7c3-f3a2ef3bb4cc tempest-VolumesAdminNegativeTest-1731188693 tempest-VolumesAdminNegativeTest-1731188693-project-admin] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:22 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-062f69e4-9a76-413e-b7c3-f3a2ef3bb4cc tempest-VolumesAdminNegativeTest-1731188693 tempest-VolumesAdminNegativeTest-1731188693-project-admin] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:22 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-062f69e4-9a76-413e-b7c3-f3a2ef3bb4cc tempest-VolumesAdminNegativeTest-1731188693 tempest-VolumesAdminNegativeTest-1731188693-project-admin] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:22 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-062f69e4-9a76-413e-b7c3-f3a2ef3bb4cc tempest-VolumesAdminNegativeTest-1731188693 tempest-VolumesAdminNegativeTest-1731188693-project-admin] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:22 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-062f69e4-9a76-413e-b7c3-f3a2ef3bb4cc tempest-VolumesAdminNegativeTest-1731188693 tempest-VolumesAdminNegativeTest-1731188693-project-admin] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:22 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-062f69e4-9a76-413e-b7c3-f3a2ef3bb4cc tempest-VolumesAdminNegativeTest-1731188693 tempest-VolumesAdminNegativeTest-1731188693-project-admin] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:22 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-062f69e4-9a76-413e-b7c3-f3a2ef3bb4cc tempest-VolumesAdminNegativeTest-1731188693 tempest-VolumesAdminNegativeTest-1731188693-project-admin] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:23 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-062f69e4-9a76-413e-b7c3-f3a2ef3bb4cc tempest-VolumesAdminNegativeTest-1731188693 tempest-VolumesAdminNegativeTest-1731188693-project-admin] HTTP exception thrown: Volume af46f4cf-086a-4976-b2d0-e0648e716121 could not be found. Apr 11 15:23:23 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-062f69e4-9a76-413e-b7c3-f3a2ef3bb4cc tempest-VolumesAdminNegativeTest-1731188693 tempest-VolumesAdminNegativeTest-1731188693-project-admin] Request method failure captured: Apr 11 15:23:23 user devstack@n-api.service[61165]: request: PUT /compute/v2.1/servers/f3a06747-0f43-4731-87e6-40629c382a6b/os-volume_attachments/63216764-be19-490d-a6be-b93ad54a8762 HTTP/1.1 Apr 11 15:23:23 user devstack@n-api.service[61165]: Accept: application/json Apr 11 15:23:23 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 15:23:23 user devstack@n-api.service[61165]: Connection: close Apr 11 15:23:23 user devstack@n-api.service[61165]: Content-Length: 74 Apr 11 15:23:23 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 15:23:23 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 15:23:23 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 15:23:23 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 15:23:23 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNXrrYx-Hlu4Vd7DaBtQnBDDoKKG320FneejgJiPUOEB_8A0ZdYeXqjOPLHYmXwmmS5mf7dOUihs6KNDsjWPTzysShoyZTzmQ2M_3fj-1KGQ5M4MlMk_FJIYqFjHonItTytPizDw5-kdpLCXMARaoh6Y2rL_ZyovygGnCkDS30EZYcYg Apr 11 15:23:23 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 15:23:23 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 15:23:23 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 15:23:23 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 15:23:23 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 15:23:23 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 15:23:23 user devstack@n-api.service[61165]: X-Project-Id: 6f23974205a64331a9a962e5aa93ade6 Apr 11 15:23:23 user devstack@n-api.service[61165]: X-Project-Name: tempest-VolumesAdminNegativeTest-1731188693 Apr 11 15:23:23 user devstack@n-api.service[61165]: X-Role: reader,admin,member Apr 11 15:23:23 user devstack@n-api.service[61165]: X-Roles: reader,admin,member Apr 11 15:23:23 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f23974205a64331a9a962e5aa93ade6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6f23974205a64331a9a962e5aa93ade6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f23974205a64331a9a962e5aa93ade6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:23:23 user devstack@n-api.service[61165]: X-Tenant: tempest-VolumesAdminNegativeTest-1731188693 Apr 11 15:23:23 user devstack@n-api.service[61165]: X-Tenant-Id: 6f23974205a64331a9a962e5aa93ade6 Apr 11 15:23:23 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1731188693 Apr 11 15:23:23 user devstack@n-api.service[61165]: X-User: tempest-VolumesAdminNegativeTest-1731188693-project-admin Apr 11 15:23:23 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 15:23:23 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 15:23:23 user devstack@n-api.service[61165]: X-User-Id: 3f1e4ddd77034d36a2aa89a5a83ef0a2 Apr 11 15:23:23 user devstack@n-api.service[61165]: X-User-Name: tempest-VolumesAdminNegativeTest-1731188693-project-admin Apr 11 15:23:23 user devstack@n-api.service[61165]: Apr 11 15:23:23 user devstack@n-api.service[61165]: {"volumeAttachment": {"volumeId": "af46f4cf-086a-4976-b2d0-e0648e716121"}} Apr 11 15:23:23 user devstack@n-api.service[61165]: method: > Apr 11 15:23:23 user devstack@n-api.service[61165]: exception: Volume af46f4cf-086a-4976-b2d0-e0648e716121 could not be found. Apr 11 15:23:23 user devstack@n-api.service[61165]: action_args: {'server_id': 'f3a06747-0f43-4731-87e6-40629c382a6b', 'id': '63216764-be19-490d-a6be-b93ad54a8762', 'body': {'volumeAttachment': {'volumeId': 'af46f4cf-086a-4976-b2d0-e0648e716121'}}} Apr 11 15:23:23 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume af46f4cf-086a-4976-b2d0-e0648e716121 could not be found. (HTTP 404) (Request-ID: req-94c92393-252a-4655-a0f7-e80b04fc37b8) Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume af46f4cf-086a-4976-b2d0-e0648e716121 could not be found. Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume af46f4cf-086a-4976-b2d0-e0648e716121 could not be found. Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume af46f4cf-086a-4976-b2d0-e0648e716121 could not be found. Apr 11 15:23:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:23:23 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-062f69e4-9a76-413e-b7c3-f3a2ef3bb4cc tempest-VolumesAdminNegativeTest-1731188693 tempest-VolumesAdminNegativeTest-1731188693-project-admin] Returning 400 to user: Volume af46f4cf-086a-4976-b2d0-e0648e716121 could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:23:23 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-062f69e4-9a76-413e-b7c3-f3a2ef3bb4cc tempest-VolumesAdminNegativeTest-1731188693 tempest-VolumesAdminNegativeTest-1731188693-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/f3a06747-0f43-4731-87e6-40629c382a6b/os-volume_attachments/63216764-be19-490d-a6be-b93ad54a8762" status: 400 len: 107 microversion: 2.1 time: 0.339472 Apr 11 15:23:23 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 51/151] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Apr 11 15:23:22 2023] PUT /compute/v2.1/servers/f3a06747-0f43-4731-87e6-40629c382a6b/os-volume_attachments/63216764-be19-490d-a6be-b93ad54a8762 => generated 107 bytes in 342 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 15:23:23 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:23 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:23 user devstack@n-api.service[61166]: DEBUG nova.objects.instance [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lazy-loading 'services' on Instance uuid f3a06747-0f43-4731-87e6-40629c382a6b {{(pid=61166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 15:23:23 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f3a06747-0f43-4731-87e6-40629c382a6b/os-volume_attachments/63216764-be19-490d-a6be-b93ad54a8762" status: 202 len: 0 microversion: 2.1 time: 0.248053 Apr 11 15:23:23 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 50/152] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 15:23:23 2023] DELETE /compute/v2.1/servers/f3a06747-0f43-4731-87e6-40629c382a6b/os-volume_attachments/63216764-be19-490d-a6be-b93ad54a8762 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:23:23 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-927b6ecf-6007-474d-aec9-76e92e7cdf5d tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:23 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-927b6ecf-6007-474d-aec9-76e92e7cdf5d tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:23 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-927b6ecf-6007-474d-aec9-76e92e7cdf5d tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:23 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-927b6ecf-6007-474d-aec9-76e92e7cdf5d tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:23 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-927b6ecf-6007-474d-aec9-76e92e7cdf5d tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:23 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-927b6ecf-6007-474d-aec9-76e92e7cdf5d tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:23 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-927b6ecf-6007-474d-aec9-76e92e7cdf5d tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:23 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-927b6ecf-6007-474d-aec9-76e92e7cdf5d tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:23 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-927b6ecf-6007-474d-aec9-76e92e7cdf5d tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3a06747-0f43-4731-87e6-40629c382a6b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043979 Apr 11 15:23:23 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 52/153] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:23:23 2023] GET /compute/v2.1/servers/f3a06747-0f43-4731-87e6-40629c382a6b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:23:23 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:23 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:23 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:23 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:23 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:23 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:23 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:23 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:23 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Going to try to terminate instance {{(pid=61165) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:23:23 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3bd4e3ea-2df2-48f8-96bd-8f8219c73bea" status: 204 len: 0 microversion: 2.1 time: 0.188659 Apr 11 15:23:23 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 52/154] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:23:23 2023] DELETE /compute/v2.1/servers/3bd4e3ea-2df2-48f8-96bd-8f8219c73bea => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:23:23 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-c11c423b-2eb1-4dd6-8ca4-a685240b09bc tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:23 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-c11c423b-2eb1-4dd6-8ca4-a685240b09bc tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c11c423b-2eb1-4dd6-8ca4-a685240b09bc tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c11c423b-2eb1-4dd6-8ca4-a685240b09bc tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c11c423b-2eb1-4dd6-8ca4-a685240b09bc tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c11c423b-2eb1-4dd6-8ca4-a685240b09bc tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c11c423b-2eb1-4dd6-8ca4-a685240b09bc tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c11c423b-2eb1-4dd6-8ca4-a685240b09bc tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:24 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-c11c423b-2eb1-4dd6-8ca4-a685240b09bc tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dacdf9131d93415596e40cb8a5416137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abbfac8ab124b919978b9085a958d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:23:24 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-c11c423b-2eb1-4dd6-8ca4-a685240b09bc tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3bd4e3ea-2df2-48f8-96bd-8f8219c73bea" status: 200 len: 1459 microversion: 2.1 time: 0.244973 Apr 11 15:23:24 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 51/155] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:23:23 2023] GET /compute/v2.1/servers/3bd4e3ea-2df2-48f8-96bd-8f8219c73bea => generated 1459 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:23:24 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-2a5a5140-4d76-4f7f-8a05-edd15d0e3b4a req-339b63e2-197e-417f-b6f8-510f4098b56c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bd4e3ea-2df2-48f8-96bd-8f8219c73bea", "name": "network-vif-unplugged", "status": "completed", "tag": "6c658c02-f85a-49aa-aaab-5aa3552ddb63"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:23:24 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-2a5a5140-4d76-4f7f-8a05-edd15d0e3b4a req-339b63e2-197e-417f-b6f8-510f4098b56c service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:24 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-2a5a5140-4d76-4f7f-8a05-edd15d0e3b4a req-339b63e2-197e-417f-b6f8-510f4098b56c service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:24 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-2a5a5140-4d76-4f7f-8a05-edd15d0e3b4a req-339b63e2-197e-417f-b6f8-510f4098b56c service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:24 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-2a5a5140-4d76-4f7f-8a05-edd15d0e3b4a req-339b63e2-197e-417f-b6f8-510f4098b56c service nova] Creating event network-vif-unplugged:6c658c02-f85a-49aa-aaab-5aa3552ddb63 for instance 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea on user Apr 11 15:23:24 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-2a5a5140-4d76-4f7f-8a05-edd15d0e3b4a req-339b63e2-197e-417f-b6f8-510f4098b56c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029258 Apr 11 15:23:24 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 53/156] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:23:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:23:26 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-4b4a7715-6cc0-4d70-bc89-88876a7d312d req-6a3fe66c-d473-41aa-a314-ae71c340304c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bd4e3ea-2df2-48f8-96bd-8f8219c73bea", "name": "network-vif-plugged", "status": "completed", "tag": "6c658c02-f85a-49aa-aaab-5aa3552ddb63"}, {"server_uuid": "3bd4e3ea-2df2-48f8-96bd-8f8219c73bea", "name": "network-vif-deleted", "tag": "6c658c02-f85a-49aa-aaab-5aa3552ddb63"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:23:26 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-4b4a7715-6cc0-4d70-bc89-88876a7d312d req-6a3fe66c-d473-41aa-a314-ae71c340304c service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:26 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-4b4a7715-6cc0-4d70-bc89-88876a7d312d req-6a3fe66c-d473-41aa-a314-ae71c340304c service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:26 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-4b4a7715-6cc0-4d70-bc89-88876a7d312d req-6a3fe66c-d473-41aa-a314-ae71c340304c service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:26 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-4b4a7715-6cc0-4d70-bc89-88876a7d312d req-6a3fe66c-d473-41aa-a314-ae71c340304c service nova] Creating event network-vif-plugged:6c658c02-f85a-49aa-aaab-5aa3552ddb63 for instance 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea on user Apr 11 15:23:26 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-4b4a7715-6cc0-4d70-bc89-88876a7d312d req-6a3fe66c-d473-41aa-a314-ae71c340304c service nova] Creating event network-vif-deleted:6c658c02-f85a-49aa-aaab-5aa3552ddb63 for instance 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea on user Apr 11 15:23:26 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-4b4a7715-6cc0-4d70-bc89-88876a7d312d req-6a3fe66c-d473-41aa-a314-ae71c340304c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033805 Apr 11 15:23:26 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 53/157] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:23:26 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:23:29 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-9b2f2474-37c0-473c-9006-1a599fbe65b2 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:29 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-9b2f2474-37c0-473c-9006-1a599fbe65b2 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:29 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:23:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-9b2f2474-37c0-473c-9006-1a599fbe65b2 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-9b2f2474-37c0-473c-9006-1a599fbe65b2 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-9b2f2474-37c0-473c-9006-1a599fbe65b2 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-9b2f2474-37c0-473c-9006-1a599fbe65b2 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-9b2f2474-37c0-473c-9006-1a599fbe65b2 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-9b2f2474-37c0-473c-9006-1a599fbe65b2 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:29 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-9b2f2474-37c0-473c-9006-1a599fbe65b2 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2b2c294d-49b2-41bf-89d0-17a560e7741f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061857 Apr 11 15:23:29 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 52/158] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:23:29 2023] GET /compute/v2.1/servers/2b2c294d-49b2-41bf-89d0-17a560e7741f/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:23:29 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:29 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:29 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:29 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:29 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:29 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:29 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:29 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:29 user devstack@n-api.service[61167]: DEBUG nova.objects.instance [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lazy-loading 'services' on Instance uuid 2b2c294d-49b2-41bf-89d0-17a560e7741f {{(pid=61167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 15:23:29 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2b2c294d-49b2-41bf-89d0-17a560e7741f/os-volume_attachments/f1eaab93-85f1-49cd-a6c4-4c499c77d2c9" status: 202 len: 0 microversion: 2.1 time: 0.323625 Apr 11 15:23:29 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 54/159] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 15:23:29 2023] DELETE /compute/v2.1/servers/2b2c294d-49b2-41bf-89d0-17a560e7741f/os-volume_attachments/f1eaab93-85f1-49cd-a6c4-4c499c77d2c9 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:23:32 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-364077b6-9e0b-4ac6-86ad-61b9e80d8e53 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:32 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-364077b6-9e0b-4ac6-86ad-61b9e80d8e53 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-364077b6-9e0b-4ac6-86ad-61b9e80d8e53 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-364077b6-9e0b-4ac6-86ad-61b9e80d8e53 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-364077b6-9e0b-4ac6-86ad-61b9e80d8e53 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-364077b6-9e0b-4ac6-86ad-61b9e80d8e53 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-364077b6-9e0b-4ac6-86ad-61b9e80d8e53 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-364077b6-9e0b-4ac6-86ad-61b9e80d8e53 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:32 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-364077b6-9e0b-4ac6-86ad-61b9e80d8e53 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2b2c294d-49b2-41bf-89d0-17a560e7741f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045705 Apr 11 15:23:32 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 54/160] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:23:32 2023] GET /compute/v2.1/servers/2b2c294d-49b2-41bf-89d0-17a560e7741f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 15:23:32 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-25d353dc-7752-4adb-a3a3-6716cd748300 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:32 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-25d353dc-7752-4adb-a3a3-6716cd748300 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-25d353dc-7752-4adb-a3a3-6716cd748300 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-25d353dc-7752-4adb-a3a3-6716cd748300 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-25d353dc-7752-4adb-a3a3-6716cd748300 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-25d353dc-7752-4adb-a3a3-6716cd748300 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-25d353dc-7752-4adb-a3a3-6716cd748300 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-25d353dc-7752-4adb-a3a3-6716cd748300 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:32 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-25d353dc-7752-4adb-a3a3-6716cd748300 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2b2c294d-49b2-41bf-89d0-17a560e7741f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042611 Apr 11 15:23:32 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 53/161] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:23:32 2023] GET /compute/v2.1/servers/2b2c294d-49b2-41bf-89d0-17a560e7741f/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 15:23:32 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:32 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:32 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Going to try to terminate instance {{(pid=61167) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:23:32 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2b2c294d-49b2-41bf-89d0-17a560e7741f" status: 204 len: 0 microversion: 2.1 time: 0.113584 Apr 11 15:23:32 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 55/162] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:23:32 2023] DELETE /compute/v2.1/servers/2b2c294d-49b2-41bf-89d0-17a560e7741f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:23:32 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-a57d6040-5d1e-4c4c-af52-854dba428b79 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:32 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-a57d6040-5d1e-4c4c-af52-854dba428b79 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-a57d6040-5d1e-4c4c-af52-854dba428b79 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-a57d6040-5d1e-4c4c-af52-854dba428b79 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-a57d6040-5d1e-4c4c-af52-854dba428b79 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-a57d6040-5d1e-4c4c-af52-854dba428b79 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-a57d6040-5d1e-4c4c-af52-854dba428b79 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-a57d6040-5d1e-4c4c-af52-854dba428b79 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:32 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-a57d6040-5d1e-4c4c-af52-854dba428b79 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab8ba2ebb8643a59d3a8a821cd1c2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67f7203b1849c0af305f88ad8284f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:23:32 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-a57d6040-5d1e-4c4c-af52-854dba428b79 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2b2c294d-49b2-41bf-89d0-17a560e7741f" status: 200 len: 1674 microversion: 2.1 time: 0.168727 Apr 11 15:23:32 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 55/163] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:23:32 2023] GET /compute/v2.1/servers/2b2c294d-49b2-41bf-89d0-17a560e7741f => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:23:32 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-1321c341-1ce1-4ec8-8d8d-8809c3bc8524 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:32 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-1321c341-1ce1-4ec8-8d8d-8809c3bc8524 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1321c341-1ce1-4ec8-8d8d-8809c3bc8524 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1321c341-1ce1-4ec8-8d8d-8809c3bc8524 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1321c341-1ce1-4ec8-8d8d-8809c3bc8524 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1321c341-1ce1-4ec8-8d8d-8809c3bc8524 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1321c341-1ce1-4ec8-8d8d-8809c3bc8524 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1321c341-1ce1-4ec8-8d8d-8809c3bc8524 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:32 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-1321c341-1ce1-4ec8-8d8d-8809c3bc8524 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d84862f-b710-48b1-9275-93fc799cf1f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052375 Apr 11 15:23:32 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 54/164] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:23:32 2023] GET /compute/v2.1/servers/8d84862f-b710-48b1-9275-93fc799cf1f9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 15:23:32 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-63745df3-8fe7-4cbd-aedf-e3fc431db5f3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:32 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-63745df3-8fe7-4cbd-aedf-e3fc431db5f3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-63745df3-8fe7-4cbd-aedf-e3fc431db5f3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-63745df3-8fe7-4cbd-aedf-e3fc431db5f3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-63745df3-8fe7-4cbd-aedf-e3fc431db5f3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-63745df3-8fe7-4cbd-aedf-e3fc431db5f3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-63745df3-8fe7-4cbd-aedf-e3fc431db5f3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-63745df3-8fe7-4cbd-aedf-e3fc431db5f3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:32 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-716d334e-f07f-4c90-a882-af95592b0a2e req-02e073d3-bccd-436d-b78c-e346aca518fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b2c294d-49b2-41bf-89d0-17a560e7741f", "name": "network-vif-unplugged", "status": "completed", "tag": "41b19aaa-a4cf-494a-97e9-c3a081d24d80"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:23:32 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-63745df3-8fe7-4cbd-aedf-e3fc431db5f3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d84862f-b710-48b1-9275-93fc799cf1f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044528 Apr 11 15:23:32 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 56/165] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:23:32 2023] GET /compute/v2.1/servers/8d84862f-b710-48b1-9275-93fc799cf1f9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:23:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-716d334e-f07f-4c90-a882-af95592b0a2e req-02e073d3-bccd-436d-b78c-e346aca518fe service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-716d334e-f07f-4c90-a882-af95592b0a2e req-02e073d3-bccd-436d-b78c-e346aca518fe service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-716d334e-f07f-4c90-a882-af95592b0a2e req-02e073d3-bccd-436d-b78c-e346aca518fe service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:32 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "761a1221-3eec-47f9-8a05-9eb545bede26"}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:23:32 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-716d334e-f07f-4c90-a882-af95592b0a2e req-02e073d3-bccd-436d-b78c-e346aca518fe service nova] Creating event network-vif-unplugged:41b19aaa-a4cf-494a-97e9-c3a081d24d80 for instance 2b2c294d-49b2-41bf-89d0-17a560e7741f on user Apr 11 15:23:32 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:32 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-716d334e-f07f-4c90-a882-af95592b0a2e req-02e073d3-bccd-436d-b78c-e346aca518fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041465 Apr 11 15:23:32 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 56/166] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:23:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:23:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:33 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/8d84862f-b710-48b1-9275-93fc799cf1f9/os-volume_attachments/33e46e47-d157-4f4d-b7cf-96f42888f78c" status: 202 len: 0 microversion: 2.1 time: 0.272370 Apr 11 15:23:33 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 55/167] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Apr 11 15:23:32 2023] PUT /compute/v2.1/servers/8d84862f-b710-48b1-9275-93fc799cf1f9/os-volume_attachments/33e46e47-d157-4f4d-b7cf-96f42888f78c => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 11 15:23:34 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-124e157e-6c9b-49dd-8d73-fdf969599509 req-f2722378-c7bf-464d-8d1d-7ac18eea6be5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b2c294d-49b2-41bf-89d0-17a560e7741f", "name": "network-vif-deleted", "tag": "41b19aaa-a4cf-494a-97e9-c3a081d24d80"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:23:34 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-124e157e-6c9b-49dd-8d73-fdf969599509 req-f2722378-c7bf-464d-8d1d-7ac18eea6be5 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:34 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-124e157e-6c9b-49dd-8d73-fdf969599509 req-f2722378-c7bf-464d-8d1d-7ac18eea6be5 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:34 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-124e157e-6c9b-49dd-8d73-fdf969599509 req-f2722378-c7bf-464d-8d1d-7ac18eea6be5 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:34 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-124e157e-6c9b-49dd-8d73-fdf969599509 req-f2722378-c7bf-464d-8d1d-7ac18eea6be5 service nova] Creating event network-vif-deleted:41b19aaa-a4cf-494a-97e9-c3a081d24d80 for instance 2b2c294d-49b2-41bf-89d0-17a560e7741f on user Apr 11 15:23:34 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-124e157e-6c9b-49dd-8d73-fdf969599509 req-f2722378-c7bf-464d-8d1d-7ac18eea6be5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032132 Apr 11 15:23:34 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 57/168] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:23:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:23:34 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-8e197f36-1694-4a85-bfce-d228fe6a0a42 req-3594471a-3417-46ca-bef1-c96097c37d8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b2c294d-49b2-41bf-89d0-17a560e7741f", "name": "network-vif-plugged", "status": "completed", "tag": "41b19aaa-a4cf-494a-97e9-c3a081d24d80"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:23:34 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-8e197f36-1694-4a85-bfce-d228fe6a0a42 req-3594471a-3417-46ca-bef1-c96097c37d8a service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:34 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-8e197f36-1694-4a85-bfce-d228fe6a0a42 req-3594471a-3417-46ca-bef1-c96097c37d8a service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:34 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-8e197f36-1694-4a85-bfce-d228fe6a0a42 req-3594471a-3417-46ca-bef1-c96097c37d8a service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:34 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-8e197f36-1694-4a85-bfce-d228fe6a0a42 req-3594471a-3417-46ca-bef1-c96097c37d8a service nova] Creating event network-vif-plugged:41b19aaa-a4cf-494a-97e9-c3a081d24d80 for instance 2b2c294d-49b2-41bf-89d0-17a560e7741f on user Apr 11 15:23:34 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-8e197f36-1694-4a85-bfce-d228fe6a0a42 req-3594471a-3417-46ca-bef1-c96097c37d8a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032058 Apr 11 15:23:34 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 57/169] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:23:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:23:43 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=7 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:23:43 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:23:43 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-23341e11-d5bc-4d22-b861-b9a0cd942edb tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:43 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-23341e11-d5bc-4d22-b861-b9a0cd942edb tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:43 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-23341e11-d5bc-4d22-b861-b9a0cd942edb tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:43 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-23341e11-d5bc-4d22-b861-b9a0cd942edb tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:43 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-23341e11-d5bc-4d22-b861-b9a0cd942edb tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:43 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-23341e11-d5bc-4d22-b861-b9a0cd942edb tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:43 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-23341e11-d5bc-4d22-b861-b9a0cd942edb tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:43 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-23341e11-d5bc-4d22-b861-b9a0cd942edb tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:43 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-23341e11-d5bc-4d22-b861-b9a0cd942edb tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cda43d26-e2f7-4e86-b850-b914957c9b57/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.129851 Apr 11 15:23:43 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 56/170] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 15:23:43 2023] GET /compute/v2.1/servers/cda43d26-e2f7-4e86-b850-b914957c9b57/os-interface => generated 1829 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:23:44 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:23:44 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:23:44 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-09f8f58a-8a75-4cd0-8844-471ad8f92e28 req-1d6a817a-067b-4130-917e-227f6d8d9bab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "tag": "ee21c1bf-90da-44fe-b6f2-26132b87c5ed"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:23:44 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-09f8f58a-8a75-4cd0-8844-471ad8f92e28 req-1d6a817a-067b-4130-917e-227f6d8d9bab service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:44 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-09f8f58a-8a75-4cd0-8844-471ad8f92e28 req-1d6a817a-067b-4130-917e-227f6d8d9bab service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:44 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-09f8f58a-8a75-4cd0-8844-471ad8f92e28 req-1d6a817a-067b-4130-917e-227f6d8d9bab service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:44 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-09f8f58a-8a75-4cd0-8844-471ad8f92e28 req-1d6a817a-067b-4130-917e-227f6d8d9bab service nova] Creating event network-changed:ee21c1bf-90da-44fe-b6f2-26132b87c5ed for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:23:44 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-09f8f58a-8a75-4cd0-8844-471ad8f92e28 req-1d6a817a-067b-4130-917e-227f6d8d9bab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034914 Apr 11 15:23:44 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 58/171] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:23:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:23:44 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-ae2cacfd-6ff2-4778-a9f1-4a0b5c494d6b tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:44 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-ae2cacfd-6ff2-4778-a9f1-4a0b5c494d6b tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:44 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:23:44 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ae2cacfd-6ff2-4778-a9f1-4a0b5c494d6b tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:44 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ae2cacfd-6ff2-4778-a9f1-4a0b5c494d6b tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:44 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ae2cacfd-6ff2-4778-a9f1-4a0b5c494d6b tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:44 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ae2cacfd-6ff2-4778-a9f1-4a0b5c494d6b tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:44 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ae2cacfd-6ff2-4778-a9f1-4a0b5c494d6b tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:44 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ae2cacfd-6ff2-4778-a9f1-4a0b5c494d6b tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:44 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:23:44 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-ae2cacfd-6ff2-4778-a9f1-4a0b5c494d6b tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d206ed111842fd95ce5eb5b3835a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e64015226c19441d87f3a6999a3a8db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:23:44 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-ae2cacfd-6ff2-4778-a9f1-4a0b5c494d6b tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31d206ed111842fd95ce5eb5b3835a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e64015226c19441d87f3a6999a3a8db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:23:44 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-ae2cacfd-6ff2-4778-a9f1-4a0b5c494d6b tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31d206ed111842fd95ce5eb5b3835a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e64015226c19441d87f3a6999a3a8db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:23:44 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-ae2cacfd-6ff2-4778-a9f1-4a0b5c494d6b tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cda43d26-e2f7-4e86-b850-b914957c9b57" status: 200 len: 2828 microversion: 2.42 time: 0.279924 Apr 11 15:23:44 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 58/172] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:23:44 2023] GET /compute/v2.1/servers/cda43d26-e2f7-4e86-b850-b914957c9b57 => generated 2828 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:23:44 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-98261d9e-ffde-471a-8d52-2c69eab3488d tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:44 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-98261d9e-ffde-471a-8d52-2c69eab3488d tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:44 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-98261d9e-ffde-471a-8d52-2c69eab3488d tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:44 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-98261d9e-ffde-471a-8d52-2c69eab3488d tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:44 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-98261d9e-ffde-471a-8d52-2c69eab3488d tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:44 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-98261d9e-ffde-471a-8d52-2c69eab3488d tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:44 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-98261d9e-ffde-471a-8d52-2c69eab3488d tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:44 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-98261d9e-ffde-471a-8d52-2c69eab3488d tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:44 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-98261d9e-ffde-471a-8d52-2c69eab3488d tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cda43d26-e2f7-4e86-b850-b914957c9b57/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.161364 Apr 11 15:23:44 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 57/173] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 15:23:44 2023] GET /compute/v2.1/servers/cda43d26-e2f7-4e86-b850-b914957c9b57/os-interface => generated 1829 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:23:44 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-63c294c5-8bb7-4f76-99f3-6331f882d853 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:44 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-63c294c5-8bb7-4f76-99f3-6331f882d853 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:44 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-63c294c5-8bb7-4f76-99f3-6331f882d853 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:44 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-63c294c5-8bb7-4f76-99f3-6331f882d853 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:44 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-63c294c5-8bb7-4f76-99f3-6331f882d853 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:44 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-63c294c5-8bb7-4f76-99f3-6331f882d853 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:44 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-63c294c5-8bb7-4f76-99f3-6331f882d853 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:44 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-63c294c5-8bb7-4f76-99f3-6331f882d853 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:44 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-63c294c5-8bb7-4f76-99f3-6331f882d853 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d84862f-b710-48b1-9275-93fc799cf1f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049495 Apr 11 15:23:44 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 59/174] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:23:44 2023] GET /compute/v2.1/servers/8d84862f-b710-48b1-9275-93fc799cf1f9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:23:45 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-3394c1de-04f3-4543-a1ce-1bca19abe45a tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:45 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-3394c1de-04f3-4543-a1ce-1bca19abe45a tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:45 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-3394c1de-04f3-4543-a1ce-1bca19abe45a tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:45 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-3394c1de-04f3-4543-a1ce-1bca19abe45a tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:45 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-3394c1de-04f3-4543-a1ce-1bca19abe45a tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:45 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-3394c1de-04f3-4543-a1ce-1bca19abe45a tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:45 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-3394c1de-04f3-4543-a1ce-1bca19abe45a tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:45 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-3394c1de-04f3-4543-a1ce-1bca19abe45a tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:45 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-3394c1de-04f3-4543-a1ce-1bca19abe45a tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d84862f-b710-48b1-9275-93fc799cf1f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047791 Apr 11 15:23:45 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 59/175] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:23:45 2023] GET /compute/v2.1/servers/8d84862f-b710-48b1-9275-93fc799cf1f9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:23:45 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:45 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:45 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:45 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:45 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:45 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:45 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:45 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:45 user devstack@n-api.service[61166]: DEBUG nova.objects.instance [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lazy-loading 'services' on Instance uuid 8d84862f-b710-48b1-9275-93fc799cf1f9 {{(pid=61166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 15:23:45 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8d84862f-b710-48b1-9275-93fc799cf1f9/os-volume_attachments/761a1221-3eec-47f9-8a05-9eb545bede26" status: 202 len: 0 microversion: 2.1 time: 0.156197 Apr 11 15:23:45 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 58/176] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 15:23:45 2023] DELETE /compute/v2.1/servers/8d84862f-b710-48b1-9275-93fc799cf1f9/os-volume_attachments/761a1221-3eec-47f9-8a05-9eb545bede26 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:23:45 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-8e6805ae-3a26-465a-85d6-88b1c9673e1f tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:45 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-8e6805ae-3a26-465a-85d6-88b1c9673e1f tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:45 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8e6805ae-3a26-465a-85d6-88b1c9673e1f tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:45 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8e6805ae-3a26-465a-85d6-88b1c9673e1f tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:45 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8e6805ae-3a26-465a-85d6-88b1c9673e1f tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:45 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8e6805ae-3a26-465a-85d6-88b1c9673e1f tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:45 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8e6805ae-3a26-465a-85d6-88b1c9673e1f tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:45 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8e6805ae-3a26-465a-85d6-88b1c9673e1f tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:45 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-8e6805ae-3a26-465a-85d6-88b1c9673e1f tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d84862f-b710-48b1-9275-93fc799cf1f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051882 Apr 11 15:23:45 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 60/177] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:23:45 2023] GET /compute/v2.1/servers/8d84862f-b710-48b1-9275-93fc799cf1f9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:23:45 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:45 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:45 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:45 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:45 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:45 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:45 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:45 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:45 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Going to try to terminate instance {{(pid=61165) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:23:46 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cda43d26-e2f7-4e86-b850-b914957c9b57" status: 204 len: 0 microversion: 2.42 time: 0.122967 Apr 11 15:23:46 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 60/178] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 15:23:45 2023] DELETE /compute/v2.1/servers/cda43d26-e2f7-4e86-b850-b914957c9b57 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 15:23:46 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-cea557dc-a8fb-4f40-a747-95d7bdf8f1eb tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:46 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-cea557dc-a8fb-4f40-a747-95d7bdf8f1eb tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:46 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-cea557dc-a8fb-4f40-a747-95d7bdf8f1eb tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:46 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-cea557dc-a8fb-4f40-a747-95d7bdf8f1eb tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:46 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-cea557dc-a8fb-4f40-a747-95d7bdf8f1eb tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:46 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-cea557dc-a8fb-4f40-a747-95d7bdf8f1eb tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:46 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-cea557dc-a8fb-4f40-a747-95d7bdf8f1eb tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:46 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-cea557dc-a8fb-4f40-a747-95d7bdf8f1eb tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:46 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-cea557dc-a8fb-4f40-a747-95d7bdf8f1eb tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d206ed111842fd95ce5eb5b3835a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e64015226c19441d87f3a6999a3a8db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:23:46 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-cea557dc-a8fb-4f40-a747-95d7bdf8f1eb tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31d206ed111842fd95ce5eb5b3835a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e64015226c19441d87f3a6999a3a8db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:23:46 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-cea557dc-a8fb-4f40-a747-95d7bdf8f1eb tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31d206ed111842fd95ce5eb5b3835a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e64015226c19441d87f3a6999a3a8db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:23:46 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-cea557dc-a8fb-4f40-a747-95d7bdf8f1eb tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cda43d26-e2f7-4e86-b850-b914957c9b57" status: 200 len: 2953 microversion: 2.42 time: 0.359741 Apr 11 15:23:46 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 59/179] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:23:46 2023] GET /compute/v2.1/servers/cda43d26-e2f7-4e86-b850-b914957c9b57 => generated 2953 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:23:46 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-59475931-8df3-461d-80f9-6397674dad9b req-cfd66b2e-a9b6-4972-9c74-44e4dacef10f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "name": "network-vif-unplugged", "status": "completed", "tag": "ee21c1bf-90da-44fe-b6f2-26132b87c5ed"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:23:46 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-59475931-8df3-461d-80f9-6397674dad9b req-cfd66b2e-a9b6-4972-9c74-44e4dacef10f service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:46 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-59475931-8df3-461d-80f9-6397674dad9b req-cfd66b2e-a9b6-4972-9c74-44e4dacef10f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:46 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-59475931-8df3-461d-80f9-6397674dad9b req-cfd66b2e-a9b6-4972-9c74-44e4dacef10f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:46 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-59475931-8df3-461d-80f9-6397674dad9b req-cfd66b2e-a9b6-4972-9c74-44e4dacef10f service nova] Creating event network-vif-unplugged:ee21c1bf-90da-44fe-b6f2-26132b87c5ed for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:23:46 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-59475931-8df3-461d-80f9-6397674dad9b req-cfd66b2e-a9b6-4972-9c74-44e4dacef10f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030680 Apr 11 15:23:46 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 61/180] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:23:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:23:46 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-a7e2d0d3-e29c-4bc0-a080-63c6f02a672c req-43389355-26d8-44df-bf08-7b31ecaa6500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "name": "network-vif-unplugged", "status": "completed", "tag": "2ac99ade-56b1-4865-b997-a9f8ef0a760b"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:23:46 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-a7e2d0d3-e29c-4bc0-a080-63c6f02a672c req-43389355-26d8-44df-bf08-7b31ecaa6500 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:46 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-a7e2d0d3-e29c-4bc0-a080-63c6f02a672c req-43389355-26d8-44df-bf08-7b31ecaa6500 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:46 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-a7e2d0d3-e29c-4bc0-a080-63c6f02a672c req-43389355-26d8-44df-bf08-7b31ecaa6500 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:46 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-a7e2d0d3-e29c-4bc0-a080-63c6f02a672c req-43389355-26d8-44df-bf08-7b31ecaa6500 service nova] Creating event network-vif-unplugged:2ac99ade-56b1-4865-b997-a9f8ef0a760b for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:23:46 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-a7e2d0d3-e29c-4bc0-a080-63c6f02a672c req-43389355-26d8-44df-bf08-7b31ecaa6500 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035475 Apr 11 15:23:46 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 61/181] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:23:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:23:46 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-fc72d3e5-a43e-462f-aa18-6435086cc8ab req-b68aeb05-72a3-47d7-9f92-70f5443b7867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "name": "network-vif-unplugged", "status": "completed", "tag": "6d794bc3-2136-4b88-92e5-4703eb113b6d"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:23:46 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-fc72d3e5-a43e-462f-aa18-6435086cc8ab req-b68aeb05-72a3-47d7-9f92-70f5443b7867 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:46 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-fc72d3e5-a43e-462f-aa18-6435086cc8ab req-b68aeb05-72a3-47d7-9f92-70f5443b7867 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:46 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-fc72d3e5-a43e-462f-aa18-6435086cc8ab req-b68aeb05-72a3-47d7-9f92-70f5443b7867 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:46 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-fc72d3e5-a43e-462f-aa18-6435086cc8ab req-b68aeb05-72a3-47d7-9f92-70f5443b7867 service nova] Creating event network-vif-unplugged:6d794bc3-2136-4b88-92e5-4703eb113b6d for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:23:46 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-fc72d3e5-a43e-462f-aa18-6435086cc8ab req-b68aeb05-72a3-47d7-9f92-70f5443b7867 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036535 Apr 11 15:23:46 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 60/182] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:23:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:23:47 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-ebeb6570-0435-4229-be91-8a0708102f40 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:47 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-ebeb6570-0435-4229-be91-8a0708102f40 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ebeb6570-0435-4229-be91-8a0708102f40 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ebeb6570-0435-4229-be91-8a0708102f40 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ebeb6570-0435-4229-be91-8a0708102f40 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ebeb6570-0435-4229-be91-8a0708102f40 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ebeb6570-0435-4229-be91-8a0708102f40 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ebeb6570-0435-4229-be91-8a0708102f40 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:47 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-ebeb6570-0435-4229-be91-8a0708102f40 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:23:47 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-ebeb6570-0435-4229-be91-8a0708102f40 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35" status: 200 len: 1659 microversion: 2.1 time: 0.176544 Apr 11 15:23:47 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 62/183] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:23:47 2023] GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35 => generated 1659 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:23:47 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-ba451fdd-7a13-48b4-8b2a-fa47e9437ea6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:47 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-ba451fdd-7a13-48b4-8b2a-fa47e9437ea6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:47 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ba451fdd-7a13-48b4-8b2a-fa47e9437ea6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:47 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ba451fdd-7a13-48b4-8b2a-fa47e9437ea6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:47 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ba451fdd-7a13-48b4-8b2a-fa47e9437ea6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:47 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ba451fdd-7a13-48b4-8b2a-fa47e9437ea6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:47 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ba451fdd-7a13-48b4-8b2a-fa47e9437ea6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:47 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ba451fdd-7a13-48b4-8b2a-fa47e9437ea6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:47 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-233707ba-8088-46b7-83a3-5196f44c977a tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:47 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-233707ba-8088-46b7-83a3-5196f44c977a tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:47 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-233707ba-8088-46b7-83a3-5196f44c977a tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:47 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-233707ba-8088-46b7-83a3-5196f44c977a tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:47 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-233707ba-8088-46b7-83a3-5196f44c977a tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:47 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-233707ba-8088-46b7-83a3-5196f44c977a tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:47 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-233707ba-8088-46b7-83a3-5196f44c977a tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:47 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-233707ba-8088-46b7-83a3-5196f44c977a tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:47 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-233707ba-8088-46b7-83a3-5196f44c977a tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] HTTP exception thrown: Instance 074896e5-8065-4b4a-b61a-653bc67718db could not be found. Apr 11 15:23:47 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-233707ba-8088-46b7-83a3-5196f44c977a tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Request method failure captured: Apr 11 15:23:47 user devstack@n-api.service[61166]: request: GET /compute/v2.1/servers/074896e5-8065-4b4a-b61a-653bc67718db HTTP/1.1 Apr 11 15:23:47 user devstack@n-api.service[61166]: Accept: application/json Apr 11 15:23:47 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 15:23:47 user devstack@n-api.service[61166]: Connection: close Apr 11 15:23:47 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 15:23:47 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 15:23:47 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 15:23:47 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 15:23:47 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 15:23:47 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNXrXMcFQG5LrIqNkMs6tMX81tcV-qsqU-HC9oBeHjM-_BooekIQRKsFuyQl7sOxO8gAZWGKd0P1an7VRE97gDRKmnIy4Mhz57hFKn3UF7b1QCCZH1LZU6_rukg5uAvSh8n3qopjxgX6QeE3Zee8Tgud7Eu2Cnujmu0AMh8LTaBs4bMo Apr 11 15:23:47 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 15:23:47 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 15:23:47 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 15:23:47 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 15:23:47 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 15:23:47 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 15:23:47 user devstack@n-api.service[61166]: X-Project-Id: bc574e5ba43d43029c450e4fa80ac501 Apr 11 15:23:47 user devstack@n-api.service[61166]: X-Project-Name: tempest-DeleteServersTestJSON-738772639 Apr 11 15:23:47 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 15:23:47 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 15:23:47 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bc574e5ba43d43029c450e4fa80ac501"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bc574e5ba43d43029c450e4fa80ac501"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bc574e5ba43d43029c450e4fa80ac501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:23:47 user devstack@n-api.service[61166]: X-Tenant: tempest-DeleteServersTestJSON-738772639 Apr 11 15:23:47 user devstack@n-api.service[61166]: X-Tenant-Id: bc574e5ba43d43029c450e4fa80ac501 Apr 11 15:23:47 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-DeleteServersTestJSON-738772639 Apr 11 15:23:47 user devstack@n-api.service[61166]: X-User: tempest-DeleteServersTestJSON-738772639-project-member Apr 11 15:23:47 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 15:23:47 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 15:23:47 user devstack@n-api.service[61166]: X-User-Id: 6b62270e2c254a888625c7e4491adf05 Apr 11 15:23:47 user devstack@n-api.service[61166]: X-User-Name: tempest-DeleteServersTestJSON-738772639-project-member Apr 11 15:23:47 user devstack@n-api.service[61166]: method: > Apr 11 15:23:47 user devstack@n-api.service[61166]: exception: Instance 074896e5-8065-4b4a-b61a-653bc67718db could not be found. Apr 11 15:23:47 user devstack@n-api.service[61166]: action_args: {'id': '074896e5-8065-4b4a-b61a-653bc67718db'} Apr 11 15:23:47 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 074896e5-8065-4b4a-b61a-653bc67718db could not be found. Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 074896e5-8065-4b4a-b61a-653bc67718db could not be found. Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 074896e5-8065-4b4a-b61a-653bc67718db could not be found. Apr 11 15:23:47 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:23:47 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-233707ba-8088-46b7-83a3-5196f44c977a tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Returning 404 to user: Instance 074896e5-8065-4b4a-b61a-653bc67718db could not be found. {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:23:47 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-233707ba-8088-46b7-83a3-5196f44c977a tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/074896e5-8065-4b4a-b61a-653bc67718db" status: 404 len: 111 microversion: 2.1 time: 0.040947 Apr 11 15:23:47 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 61/184] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:23:47 2023] GET /compute/v2.1/servers/074896e5-8065-4b4a-b61a-653bc67718db => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:23:47 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-ba451fdd-7a13-48b4-8b2a-fa47e9437ea6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:23:47 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-ba451fdd-7a13-48b4-8b2a-fa47e9437ea6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35" status: 200 len: 1659 microversion: 2.1 time: 0.169460 Apr 11 15:23:47 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 62/185] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:23:47 2023] GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35 => generated 1659 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:23:47 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-36de71cd-322b-4aea-92bc-55c1a2c01b28 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:47 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-36de71cd-322b-4aea-92bc-55c1a2c01b28 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-36de71cd-322b-4aea-92bc-55c1a2c01b28 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-36de71cd-322b-4aea-92bc-55c1a2c01b28 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-36de71cd-322b-4aea-92bc-55c1a2c01b28 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-36de71cd-322b-4aea-92bc-55c1a2c01b28 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-36de71cd-322b-4aea-92bc-55c1a2c01b28 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-36de71cd-322b-4aea-92bc-55c1a2c01b28 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:47 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-36de71cd-322b-4aea-92bc-55c1a2c01b28 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] HTTP exception thrown: Instance 074896e5-8065-4b4a-b61a-653bc67718db could not be found. Apr 11 15:23:47 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-36de71cd-322b-4aea-92bc-55c1a2c01b28 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Request method failure captured: Apr 11 15:23:47 user devstack@n-api.service[61167]: request: GET /compute/v2.1/servers/074896e5-8065-4b4a-b61a-653bc67718db/os-volume_attachments HTTP/1.1 Apr 11 15:23:47 user devstack@n-api.service[61167]: Accept: application/json Apr 11 15:23:47 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 15:23:47 user devstack@n-api.service[61167]: Connection: close Apr 11 15:23:47 user devstack@n-api.service[61167]: Content-Length: 0 Apr 11 15:23:47 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 15:23:47 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 15:23:47 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 15:23:47 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 15:23:47 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNXrXMcFQG5LrIqNkMs6tMX81tcV-qsqU-HC9oBeHjM-_BooekIQRKsFuyQl7sOxO8gAZWGKd0P1an7VRE97gDRKmnIy4Mhz57hFKn3UF7b1QCCZH1LZU6_rukg5uAvSh8n3qopjxgX6QeE3Zee8Tgud7Eu2Cnujmu0AMh8LTaBs4bMo Apr 11 15:23:47 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 15:23:47 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 15:23:47 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 15:23:47 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 15:23:47 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 15:23:47 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 15:23:47 user devstack@n-api.service[61167]: X-Project-Id: bc574e5ba43d43029c450e4fa80ac501 Apr 11 15:23:47 user devstack@n-api.service[61167]: X-Project-Name: tempest-DeleteServersTestJSON-738772639 Apr 11 15:23:47 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 15:23:47 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 15:23:47 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bc574e5ba43d43029c450e4fa80ac501"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bc574e5ba43d43029c450e4fa80ac501"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bc574e5ba43d43029c450e4fa80ac501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:23:47 user devstack@n-api.service[61167]: X-Tenant: tempest-DeleteServersTestJSON-738772639 Apr 11 15:23:47 user devstack@n-api.service[61167]: X-Tenant-Id: bc574e5ba43d43029c450e4fa80ac501 Apr 11 15:23:47 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-DeleteServersTestJSON-738772639 Apr 11 15:23:47 user devstack@n-api.service[61167]: X-User: tempest-DeleteServersTestJSON-738772639-project-member Apr 11 15:23:47 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 15:23:47 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 15:23:47 user devstack@n-api.service[61167]: X-User-Id: 6b62270e2c254a888625c7e4491adf05 Apr 11 15:23:47 user devstack@n-api.service[61167]: X-User-Name: tempest-DeleteServersTestJSON-738772639-project-member Apr 11 15:23:47 user devstack@n-api.service[61167]: method: > Apr 11 15:23:47 user devstack@n-api.service[61167]: exception: Instance 074896e5-8065-4b4a-b61a-653bc67718db could not be found. Apr 11 15:23:47 user devstack@n-api.service[61167]: action_args: {'server_id': '074896e5-8065-4b4a-b61a-653bc67718db'} Apr 11 15:23:47 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 074896e5-8065-4b4a-b61a-653bc67718db could not be found. Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 074896e5-8065-4b4a-b61a-653bc67718db could not be found. Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 074896e5-8065-4b4a-b61a-653bc67718db could not be found. Apr 11 15:23:47 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:23:47 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-36de71cd-322b-4aea-92bc-55c1a2c01b28 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Returning 404 to user: Instance 074896e5-8065-4b4a-b61a-653bc67718db could not be found. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:23:47 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-36de71cd-322b-4aea-92bc-55c1a2c01b28 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/074896e5-8065-4b4a-b61a-653bc67718db/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035034 Apr 11 15:23:47 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 63/186] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:23:47 2023] GET /compute/v2.1/servers/074896e5-8065-4b4a-b61a-653bc67718db/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:23:48 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "name": "network-vif-plugged", "status": "completed", "tag": "ee21c1bf-90da-44fe-b6f2-26132b87c5ed"}, {"server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "name": "network-vif-unplugged", "status": "completed", "tag": "097c3cb1-bc8f-42c3-be49-73d500fdbc39"}, {"server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "name": "network-vif-plugged", "status": "completed", "tag": "097c3cb1-bc8f-42c3-be49-73d500fdbc39"}, {"server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "name": "network-vif-unplugged", "status": "completed", "tag": "d9f2f28e-bb0a-4d1b-a831-e2c493521408"}, {"server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "name": "network-vif-plugged", "status": "completed", "tag": "d9f2f28e-bb0a-4d1b-a831-e2c493521408"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:23:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:48 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] Creating event network-vif-plugged:ee21c1bf-90da-44fe-b6f2-26132b87c5ed for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:23:48 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] Creating event network-vif-unplugged:097c3cb1-bc8f-42c3-be49-73d500fdbc39 for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:23:48 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] Creating event network-vif-plugged:097c3cb1-bc8f-42c3-be49-73d500fdbc39 for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:23:48 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] Creating event network-vif-unplugged:d9f2f28e-bb0a-4d1b-a831-e2c493521408 for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:23:48 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] Creating event network-vif-plugged:d9f2f28e-bb0a-4d1b-a831-e2c493521408 for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:23:48 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.036038 Apr 11 15:23:48 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 62/187] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:23:48 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:23:48 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-b5c6d887-ef09-4d87-8145-e1b5fa869f35 req-d71805a1-dffd-4667-9ac4-4bc0b671d6b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "name": "network-vif-plugged", "status": "completed", "tag": "2ac99ade-56b1-4865-b997-a9f8ef0a760b"}, {"server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "name": "network-vif-unplugged", "status": "completed", "tag": "65d1d6cb-a27f-4eae-822e-459770a9a587"}, {"server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "name": "network-vif-plugged", "status": "completed", "tag": "65d1d6cb-a27f-4eae-822e-459770a9a587"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:23:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-b5c6d887-ef09-4d87-8145-e1b5fa869f35 req-d71805a1-dffd-4667-9ac4-4bc0b671d6b6 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-b5c6d887-ef09-4d87-8145-e1b5fa869f35 req-d71805a1-dffd-4667-9ac4-4bc0b671d6b6 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-b5c6d887-ef09-4d87-8145-e1b5fa869f35 req-d71805a1-dffd-4667-9ac4-4bc0b671d6b6 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:48 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-b5c6d887-ef09-4d87-8145-e1b5fa869f35 req-d71805a1-dffd-4667-9ac4-4bc0b671d6b6 service nova] Creating event network-vif-plugged:2ac99ade-56b1-4865-b997-a9f8ef0a760b for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:23:48 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-b5c6d887-ef09-4d87-8145-e1b5fa869f35 req-d71805a1-dffd-4667-9ac4-4bc0b671d6b6 service nova] Creating event network-vif-unplugged:65d1d6cb-a27f-4eae-822e-459770a9a587 for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:23:48 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-b5c6d887-ef09-4d87-8145-e1b5fa869f35 req-d71805a1-dffd-4667-9ac4-4bc0b671d6b6 service nova] Creating event network-vif-plugged:65d1d6cb-a27f-4eae-822e-459770a9a587 for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:23:48 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-b5c6d887-ef09-4d87-8145-e1b5fa869f35 req-d71805a1-dffd-4667-9ac4-4bc0b671d6b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.030692 Apr 11 15:23:48 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 63/188] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:23:48 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:23:49 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-ff832b1d-1b9e-4b39-a150-bbbf933defcf req-f50a14eb-e3ed-4f89-990f-ef83ce36fdc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "name": "network-vif-plugged", "status": "completed", "tag": "6d794bc3-2136-4b88-92e5-4703eb113b6d"}, {"server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "name": "network-vif-unplugged", "status": "completed", "tag": "e9f0f991-6f64-45e6-9ce7-3f279f5ce31f"}, {"server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "name": "network-vif-plugged", "status": "completed", "tag": "e9f0f991-6f64-45e6-9ce7-3f279f5ce31f"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:23:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-ff832b1d-1b9e-4b39-a150-bbbf933defcf req-f50a14eb-e3ed-4f89-990f-ef83ce36fdc5 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-ff832b1d-1b9e-4b39-a150-bbbf933defcf req-f50a14eb-e3ed-4f89-990f-ef83ce36fdc5 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-ff832b1d-1b9e-4b39-a150-bbbf933defcf req-f50a14eb-e3ed-4f89-990f-ef83ce36fdc5 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:49 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-ff832b1d-1b9e-4b39-a150-bbbf933defcf req-f50a14eb-e3ed-4f89-990f-ef83ce36fdc5 service nova] Creating event network-vif-plugged:6d794bc3-2136-4b88-92e5-4703eb113b6d for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:23:49 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-ff832b1d-1b9e-4b39-a150-bbbf933defcf req-f50a14eb-e3ed-4f89-990f-ef83ce36fdc5 service nova] Creating event network-vif-unplugged:e9f0f991-6f64-45e6-9ce7-3f279f5ce31f for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:23:49 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-ff832b1d-1b9e-4b39-a150-bbbf933defcf req-f50a14eb-e3ed-4f89-990f-ef83ce36fdc5 service nova] Creating event network-vif-plugged:e9f0f991-6f64-45e6-9ce7-3f279f5ce31f for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:23:49 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-ff832b1d-1b9e-4b39-a150-bbbf933defcf req-f50a14eb-e3ed-4f89-990f-ef83ce36fdc5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.038593 Apr 11 15:23:49 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 64/189] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:23:49 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:23:49 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-3600eceb-3953-42f3-a0d7-900ff34f1b00 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:49 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-3600eceb-3953-42f3-a0d7-900ff34f1b00 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3600eceb-3953-42f3-a0d7-900ff34f1b00 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3600eceb-3953-42f3-a0d7-900ff34f1b00 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3600eceb-3953-42f3-a0d7-900ff34f1b00 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3600eceb-3953-42f3-a0d7-900ff34f1b00 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3600eceb-3953-42f3-a0d7-900ff34f1b00 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3600eceb-3953-42f3-a0d7-900ff34f1b00 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:49 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-3600eceb-3953-42f3-a0d7-900ff34f1b00 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] HTTP exception thrown: Instance 074896e5-8065-4b4a-b61a-653bc67718db could not be found. Apr 11 15:23:49 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-3600eceb-3953-42f3-a0d7-900ff34f1b00 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Request method failure captured: Apr 11 15:23:49 user devstack@n-api.service[61166]: request: DELETE /compute/v2.1/servers/074896e5-8065-4b4a-b61a-653bc67718db HTTP/1.1 Apr 11 15:23:49 user devstack@n-api.service[61166]: Accept: application/json Apr 11 15:23:49 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 15:23:49 user devstack@n-api.service[61166]: Connection: close Apr 11 15:23:49 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 15:23:49 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 15:23:49 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 15:23:49 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 15:23:49 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 15:23:49 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNXrXMcFQG5LrIqNkMs6tMX81tcV-qsqU-HC9oBeHjM-_BooekIQRKsFuyQl7sOxO8gAZWGKd0P1an7VRE97gDRKmnIy4Mhz57hFKn3UF7b1QCCZH1LZU6_rukg5uAvSh8n3qopjxgX6QeE3Zee8Tgud7Eu2Cnujmu0AMh8LTaBs4bMo Apr 11 15:23:49 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 15:23:49 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 15:23:49 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 15:23:49 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 15:23:49 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 15:23:49 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 15:23:49 user devstack@n-api.service[61166]: X-Project-Id: bc574e5ba43d43029c450e4fa80ac501 Apr 11 15:23:49 user devstack@n-api.service[61166]: X-Project-Name: tempest-DeleteServersTestJSON-738772639 Apr 11 15:23:49 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 15:23:49 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 15:23:49 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bc574e5ba43d43029c450e4fa80ac501"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bc574e5ba43d43029c450e4fa80ac501"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bc574e5ba43d43029c450e4fa80ac501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:23:49 user devstack@n-api.service[61166]: X-Tenant: tempest-DeleteServersTestJSON-738772639 Apr 11 15:23:49 user devstack@n-api.service[61166]: X-Tenant-Id: bc574e5ba43d43029c450e4fa80ac501 Apr 11 15:23:49 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-DeleteServersTestJSON-738772639 Apr 11 15:23:49 user devstack@n-api.service[61166]: X-User: tempest-DeleteServersTestJSON-738772639-project-member Apr 11 15:23:49 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 15:23:49 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 15:23:49 user devstack@n-api.service[61166]: X-User-Id: 6b62270e2c254a888625c7e4491adf05 Apr 11 15:23:49 user devstack@n-api.service[61166]: X-User-Name: tempest-DeleteServersTestJSON-738772639-project-member Apr 11 15:23:49 user devstack@n-api.service[61166]: method: > Apr 11 15:23:49 user devstack@n-api.service[61166]: exception: Instance 074896e5-8065-4b4a-b61a-653bc67718db could not be found. Apr 11 15:23:49 user devstack@n-api.service[61166]: action_args: {'id': '074896e5-8065-4b4a-b61a-653bc67718db'} Apr 11 15:23:49 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 074896e5-8065-4b4a-b61a-653bc67718db could not be found. Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 074896e5-8065-4b4a-b61a-653bc67718db could not be found. Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 074896e5-8065-4b4a-b61a-653bc67718db could not be found. Apr 11 15:23:49 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:23:49 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-3600eceb-3953-42f3-a0d7-900ff34f1b00 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Returning 404 to user: Instance 074896e5-8065-4b4a-b61a-653bc67718db could not be found. {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:23:49 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-3600eceb-3953-42f3-a0d7-900ff34f1b00 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/074896e5-8065-4b4a-b61a-653bc67718db" status: 404 len: 111 microversion: 2.1 time: 0.039225 Apr 11 15:23:49 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 63/190] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:23:49 2023] DELETE /compute/v2.1/servers/074896e5-8065-4b4a-b61a-653bc67718db => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:23:49 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-9a4f00d1-99d0-413f-8f1f-a3f4b1ebef55 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:49 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-9a4f00d1-99d0-413f-8f1f-a3f4b1ebef55 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-9a4f00d1-99d0-413f-8f1f-a3f4b1ebef55 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-9a4f00d1-99d0-413f-8f1f-a3f4b1ebef55 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-9a4f00d1-99d0-413f-8f1f-a3f4b1ebef55 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-9a4f00d1-99d0-413f-8f1f-a3f4b1ebef55 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-9a4f00d1-99d0-413f-8f1f-a3f4b1ebef55 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-9a4f00d1-99d0-413f-8f1f-a3f4b1ebef55 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:49 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-9a4f00d1-99d0-413f-8f1f-a3f4b1ebef55 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] HTTP exception thrown: Instance 074896e5-8065-4b4a-b61a-653bc67718db could not be found. Apr 11 15:23:49 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-9a4f00d1-99d0-413f-8f1f-a3f4b1ebef55 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Request method failure captured: Apr 11 15:23:49 user devstack@n-api.service[61165]: request: GET /compute/v2.1/servers/074896e5-8065-4b4a-b61a-653bc67718db HTTP/1.1 Apr 11 15:23:49 user devstack@n-api.service[61165]: Accept: application/json Apr 11 15:23:49 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 15:23:49 user devstack@n-api.service[61165]: Connection: close Apr 11 15:23:49 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 15:23:49 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 15:23:49 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 15:23:49 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 15:23:49 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 15:23:49 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNXrXMcFQG5LrIqNkMs6tMX81tcV-qsqU-HC9oBeHjM-_BooekIQRKsFuyQl7sOxO8gAZWGKd0P1an7VRE97gDRKmnIy4Mhz57hFKn3UF7b1QCCZH1LZU6_rukg5uAvSh8n3qopjxgX6QeE3Zee8Tgud7Eu2Cnujmu0AMh8LTaBs4bMo Apr 11 15:23:49 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 15:23:49 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 15:23:49 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 15:23:49 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 15:23:49 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 15:23:49 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 15:23:49 user devstack@n-api.service[61165]: X-Project-Id: bc574e5ba43d43029c450e4fa80ac501 Apr 11 15:23:49 user devstack@n-api.service[61165]: X-Project-Name: tempest-DeleteServersTestJSON-738772639 Apr 11 15:23:49 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 15:23:49 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 15:23:49 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bc574e5ba43d43029c450e4fa80ac501"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bc574e5ba43d43029c450e4fa80ac501"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bc574e5ba43d43029c450e4fa80ac501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:23:49 user devstack@n-api.service[61165]: X-Tenant: tempest-DeleteServersTestJSON-738772639 Apr 11 15:23:49 user devstack@n-api.service[61165]: X-Tenant-Id: bc574e5ba43d43029c450e4fa80ac501 Apr 11 15:23:49 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-DeleteServersTestJSON-738772639 Apr 11 15:23:49 user devstack@n-api.service[61165]: X-User: tempest-DeleteServersTestJSON-738772639-project-member Apr 11 15:23:49 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 15:23:49 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 15:23:49 user devstack@n-api.service[61165]: X-User-Id: 6b62270e2c254a888625c7e4491adf05 Apr 11 15:23:49 user devstack@n-api.service[61165]: X-User-Name: tempest-DeleteServersTestJSON-738772639-project-member Apr 11 15:23:49 user devstack@n-api.service[61165]: method: > Apr 11 15:23:49 user devstack@n-api.service[61165]: exception: Instance 074896e5-8065-4b4a-b61a-653bc67718db could not be found. Apr 11 15:23:49 user devstack@n-api.service[61165]: action_args: {'id': '074896e5-8065-4b4a-b61a-653bc67718db'} Apr 11 15:23:49 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 074896e5-8065-4b4a-b61a-653bc67718db could not be found. Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 074896e5-8065-4b4a-b61a-653bc67718db could not be found. Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 074896e5-8065-4b4a-b61a-653bc67718db could not be found. Apr 11 15:23:49 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:23:49 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-9a4f00d1-99d0-413f-8f1f-a3f4b1ebef55 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Returning 404 to user: Instance 074896e5-8065-4b4a-b61a-653bc67718db could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:23:49 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-9a4f00d1-99d0-413f-8f1f-a3f4b1ebef55 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/074896e5-8065-4b4a-b61a-653bc67718db" status: 404 len: 111 microversion: 2.1 time: 0.035595 Apr 11 15:23:49 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 64/191] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:23:49 2023] GET /compute/v2.1/servers/074896e5-8065-4b4a-b61a-653bc67718db => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 15:23:50 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-8a247a61-a4bd-40cb-8748-72bd6180a958 req-248aa0d4-5764-41ec-8781-aee8736a1d66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "name": "network-vif-deleted", "tag": "ee21c1bf-90da-44fe-b6f2-26132b87c5ed"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:23:50 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-8a247a61-a4bd-40cb-8748-72bd6180a958 req-248aa0d4-5764-41ec-8781-aee8736a1d66 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:50 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-8a247a61-a4bd-40cb-8748-72bd6180a958 req-248aa0d4-5764-41ec-8781-aee8736a1d66 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:50 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-8a247a61-a4bd-40cb-8748-72bd6180a958 req-248aa0d4-5764-41ec-8781-aee8736a1d66 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:50 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-8a247a61-a4bd-40cb-8748-72bd6180a958 req-248aa0d4-5764-41ec-8781-aee8736a1d66 service nova] Creating event network-vif-deleted:ee21c1bf-90da-44fe-b6f2-26132b87c5ed for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:23:50 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-8a247a61-a4bd-40cb-8748-72bd6180a958 req-248aa0d4-5764-41ec-8781-aee8736a1d66 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049651 Apr 11 15:23:50 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 65/192] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:23:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:23:52 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-785051320", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef"}]}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:23:52 user devstack@n-api.service[61166]: DEBUG nova.network.neutron [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] validate_networks() for [('1cf4cec3-ff08-4320-89e4-aa7e8cf75eef', None, None, None, None, None)] {{(pid=61166) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:23:52 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Flavor limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:23:52 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Image limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:23:52 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Flavor pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:23:52 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Image pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:23:52 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:23:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:52 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Getting quotas for project ddc05e9bf5ab426982ccb3092ad596e4. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:23:52 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Getting quotas for user 1d60ce27bfad4d7c9b976e834df35ad4 and project ddc05e9bf5ab426982ccb3092ad596e4. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:23:52 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Going to run 1 instances... {{(pid=61166) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:23:52 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:23:52 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-63cee9d3-8e75-4c36-bcd8-10fbf80c90bc req-f04f14ea-5bbe-4f38-9567-f33bc402c480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "name": "network-vif-deleted", "tag": "e9f0f991-6f64-45e6-9ce7-3f279f5ce31f"}, {"server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "name": "network-vif-deleted", "tag": "d9f2f28e-bb0a-4d1b-a831-e2c493521408"}, {"server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "name": "network-vif-deleted", "tag": "65d1d6cb-a27f-4eae-822e-459770a9a587"}, {"server_uuid": "cda43d26-e2f7-4e86-b850-b914957c9b57", "name": "network-vif-deleted", "tag": "6d794bc3-2136-4b88-92e5-4703eb113b6d"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:23:52 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.772260 Apr 11 15:23:52 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 64/193] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 15:23:52 2023] POST /compute/v2.1/servers => generated 378 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 15:23:52 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-63cee9d3-8e75-4c36-bcd8-10fbf80c90bc req-f04f14ea-5bbe-4f38-9567-f33bc402c480 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:52 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-63cee9d3-8e75-4c36-bcd8-10fbf80c90bc req-f04f14ea-5bbe-4f38-9567-f33bc402c480 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:52 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-63cee9d3-8e75-4c36-bcd8-10fbf80c90bc req-f04f14ea-5bbe-4f38-9567-f33bc402c480 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:52 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-5d8f45e3-de0a-4c53-9c15-04b1128eb20a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:52 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-5d8f45e3-de0a-4c53-9c15-04b1128eb20a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:52 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-63cee9d3-8e75-4c36-bcd8-10fbf80c90bc req-f04f14ea-5bbe-4f38-9567-f33bc402c480 service nova] Creating event network-vif-deleted:e9f0f991-6f64-45e6-9ce7-3f279f5ce31f for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:23:52 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-63cee9d3-8e75-4c36-bcd8-10fbf80c90bc req-f04f14ea-5bbe-4f38-9567-f33bc402c480 service nova] Creating event network-vif-deleted:d9f2f28e-bb0a-4d1b-a831-e2c493521408 for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:23:52 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-63cee9d3-8e75-4c36-bcd8-10fbf80c90bc req-f04f14ea-5bbe-4f38-9567-f33bc402c480 service nova] Creating event network-vif-deleted:65d1d6cb-a27f-4eae-822e-459770a9a587 for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:23:52 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-63cee9d3-8e75-4c36-bcd8-10fbf80c90bc req-f04f14ea-5bbe-4f38-9567-f33bc402c480 service nova] Creating event network-vif-deleted:6d794bc3-2136-4b88-92e5-4703eb113b6d for instance cda43d26-e2f7-4e86-b850-b914957c9b57 on user Apr 11 15:23:52 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-63cee9d3-8e75-4c36-bcd8-10fbf80c90bc req-f04f14ea-5bbe-4f38-9567-f33bc402c480 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.040328 Apr 11 15:23:52 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 65/194] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:23:52 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:23:53 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-5d8f45e3-de0a-4c53-9c15-04b1128eb20a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:23:53 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-5d8f45e3-de0a-4c53-9c15-04b1128eb20a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:23:53 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-5d8f45e3-de0a-4c53-9c15-04b1128eb20a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:23:53 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-5d8f45e3-de0a-4c53-9c15-04b1128eb20a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0d90fd2-6a95-43c4-8756-e82071d99154" status: 200 len: 1394 microversion: 2.87 time: 0.086975 Apr 11 15:23:53 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 66/195] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:23:52 2023] GET /compute/v2.1/servers/b0d90fd2-6a95-43c4-8756-e82071d99154 => generated 1394 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:23:55 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-80e01595-cfc0-4a5c-a1e6-64b8307328ee req-880cd608-9a98-4378-9d2e-117fe8d4ac09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0d90fd2-6a95-43c4-8756-e82071d99154", "tag": "4718fa68-0eb9-4592-8c43-981438e3d0b8"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:23:55 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-80e01595-cfc0-4a5c-a1e6-64b8307328ee req-880cd608-9a98-4378-9d2e-117fe8d4ac09 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:55 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-80e01595-cfc0-4a5c-a1e6-64b8307328ee req-880cd608-9a98-4378-9d2e-117fe8d4ac09 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:55 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-80e01595-cfc0-4a5c-a1e6-64b8307328ee req-880cd608-9a98-4378-9d2e-117fe8d4ac09 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:55 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-80e01595-cfc0-4a5c-a1e6-64b8307328ee req-880cd608-9a98-4378-9d2e-117fe8d4ac09 service nova] Creating event network-changed:4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance b0d90fd2-6a95-43c4-8756-e82071d99154 on user Apr 11 15:23:55 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-80e01595-cfc0-4a5c-a1e6-64b8307328ee req-880cd608-9a98-4378-9d2e-117fe8d4ac09 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029142 Apr 11 15:23:55 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 65/196] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:23:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:23:56 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-be2ea09d-ae8c-43f9-9bd5-ee2d0755eafa tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:56 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-be2ea09d-ae8c-43f9-9bd5-ee2d0755eafa tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:56 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-be2ea09d-ae8c-43f9-9bd5-ee2d0755eafa tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:56 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-be2ea09d-ae8c-43f9-9bd5-ee2d0755eafa tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:56 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-be2ea09d-ae8c-43f9-9bd5-ee2d0755eafa tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:56 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-be2ea09d-ae8c-43f9-9bd5-ee2d0755eafa tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:56 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-be2ea09d-ae8c-43f9-9bd5-ee2d0755eafa tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:56 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-be2ea09d-ae8c-43f9-9bd5-ee2d0755eafa tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:56 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-be2ea09d-ae8c-43f9-9bd5-ee2d0755eafa tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] HTTP exception thrown: Instance 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5 could not be found. Apr 11 15:23:56 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-be2ea09d-ae8c-43f9-9bd5-ee2d0755eafa tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Request method failure captured: Apr 11 15:23:56 user devstack@n-api.service[61165]: request: GET /compute/v2.1/servers/4b1dedd0-ae18-421b-b83a-a7b2c22c65d5 HTTP/1.1 Apr 11 15:23:56 user devstack@n-api.service[61165]: Accept: application/json Apr 11 15:23:56 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 15:23:56 user devstack@n-api.service[61165]: Connection: close Apr 11 15:23:56 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 15:23:56 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 15:23:56 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 15:23:56 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 15:23:56 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 15:23:56 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNXrnSgO-fOJ9yzzthdf4KOEghm0slg-6cmjwR8dtVB-7Q614oG6SUy8HyvFhtQBN7-S12HpP2EQbYgaEX_gMfpuysGRqFiah3fU8u5ZIQh07JGvmpTFx3UYZPxJ3Pz9p9zMZ_m-eV1L-xRsHMqG7yn1CWP9hdNdU2h1BNCz_HXA_qPg Apr 11 15:23:56 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 15:23:56 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 15:23:56 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 15:23:56 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 15:23:56 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 15:23:56 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 15:23:56 user devstack@n-api.service[61165]: X-Project-Id: b4a341ccfc0b4f08bb2e97083143dd40 Apr 11 15:23:56 user devstack@n-api.service[61165]: X-Project-Name: tempest-VolumesActionsTest-1278032672 Apr 11 15:23:56 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 15:23:56 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 15:23:56 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4a341ccfc0b4f08bb2e97083143dd40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b4a341ccfc0b4f08bb2e97083143dd40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4a341ccfc0b4f08bb2e97083143dd40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:23:56 user devstack@n-api.service[61165]: X-Tenant: tempest-VolumesActionsTest-1278032672 Apr 11 15:23:56 user devstack@n-api.service[61165]: X-Tenant-Id: b4a341ccfc0b4f08bb2e97083143dd40 Apr 11 15:23:56 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-VolumesActionsTest-1278032672 Apr 11 15:23:56 user devstack@n-api.service[61165]: X-User: tempest-VolumesActionsTest-1278032672-project-member Apr 11 15:23:56 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 15:23:56 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 15:23:56 user devstack@n-api.service[61165]: X-User-Id: acc44d2042554ca0b0bde4b2de5b566a Apr 11 15:23:56 user devstack@n-api.service[61165]: X-User-Name: tempest-VolumesActionsTest-1278032672-project-member Apr 11 15:23:56 user devstack@n-api.service[61165]: method: > Apr 11 15:23:56 user devstack@n-api.service[61165]: exception: Instance 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5 could not be found. Apr 11 15:23:56 user devstack@n-api.service[61165]: action_args: {'id': '4b1dedd0-ae18-421b-b83a-a7b2c22c65d5'} Apr 11 15:23:56 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5 could not be found. Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5 could not be found. Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5 could not be found. Apr 11 15:23:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:23:56 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-be2ea09d-ae8c-43f9-9bd5-ee2d0755eafa tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Returning 404 to user: Instance 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5 could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:23:56 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-be2ea09d-ae8c-43f9-9bd5-ee2d0755eafa tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b1dedd0-ae18-421b-b83a-a7b2c22c65d5" status: 404 len: 111 microversion: 2.1 time: 0.028213 Apr 11 15:23:56 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 66/197] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:23:56 2023] GET /compute/v2.1/servers/4b1dedd0-ae18-421b-b83a-a7b2c22c65d5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:23:56 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1438339496", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "networks": [{"uuid": "5b9dc948-4f8b-460a-bc87-04cf194f5c08"}]}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:23:56 user devstack@n-api.service[61167]: DEBUG nova.network.neutron [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] validate_networks() for [('5b9dc948-4f8b-460a-bc87-04cf194f5c08', None, None, None, None, None)] {{(pid=61167) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:23:56 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Flavor limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:23:56 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Image limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:23:56 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Flavor pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:23:56 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Image pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:23:56 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:23:56 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:56 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:56 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:56 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:23:56 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:23:56 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:23:56 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Getting quotas for project b4a341ccfc0b4f08bb2e97083143dd40. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:23:56 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Getting quotas for user acc44d2042554ca0b0bde4b2de5b566a and project b4a341ccfc0b4f08bb2e97083143dd40. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:23:56 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Going to run 1 instances... {{(pid=61167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:23:56 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52fe638c-5ada-47d5-b376-233bfa808a37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:23:57 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.499128 Apr 11 15:23:57 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 67/198] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 15:23:56 2023] POST /compute/v2.1/servers => generated 378 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 15:23:57 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-1330e0bd-4d7c-40ee-bfa0-eae85ddccba2 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:23:57 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-1330e0bd-4d7c-40ee-bfa0-eae85ddccba2 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:23:57 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-1330e0bd-4d7c-40ee-bfa0-eae85ddccba2 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc44d2042554ca0b0bde4b2de5b566a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a341ccfc0b4f08bb2e97083143dd40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:23:57 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-1330e0bd-4d7c-40ee-bfa0-eae85ddccba2 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] 10.0.0.210 "GET /compute/v2.1/servers/068f10b4-086e-4af7-a53e-f6ece73d01e4" status: 200 len: 1208 microversion: 2.1 time: 0.061811 Apr 11 15:23:57 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 66/199] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:23:57 2023] GET /compute/v2.1/servers/068f10b4-086e-4af7-a53e-f6ece73d01e4 => generated 1208 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:24:00 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-5a8b542f-f374-40d6-ab32-3d632acae26d req-b6e7d844-3150-4085-9a4f-814452ce09d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "068f10b4-086e-4af7-a53e-f6ece73d01e4", "tag": "7774938e-52d1-4c9a-8bc5-db84a905791b"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:24:00 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-5a8b542f-f374-40d6-ab32-3d632acae26d req-b6e7d844-3150-4085-9a4f-814452ce09d1 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:00 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-5a8b542f-f374-40d6-ab32-3d632acae26d req-b6e7d844-3150-4085-9a4f-814452ce09d1 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:00 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-5a8b542f-f374-40d6-ab32-3d632acae26d req-b6e7d844-3150-4085-9a4f-814452ce09d1 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:00 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-5a8b542f-f374-40d6-ab32-3d632acae26d req-b6e7d844-3150-4085-9a4f-814452ce09d1 service nova] Creating event network-changed:7774938e-52d1-4c9a-8bc5-db84a905791b for instance 068f10b4-086e-4af7-a53e-f6ece73d01e4 on user Apr 11 15:24:00 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-5a8b542f-f374-40d6-ab32-3d632acae26d req-b6e7d844-3150-4085-9a4f-814452ce09d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038119 Apr 11 15:24:00 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 67/200] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:24:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:24:01 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-88a5aaab-ca4d-4f81-84e1-1d108fc4f1cb tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Action: 'create', calling method: .version_select at 0x7f4c2ef7b490>, body: {"keypair": {"name": "tempest-keypair-2006224467", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsR3rBvaQjIOxYeSz3NLQVsG9AGAuW2r0O6Mjm+I+MgG/J7ZAhRru4tm3W0cW0RBt+UkxQ8v87/p6J8fnQe0XnKTLliPQO8+NI0fNGxiZv5WBaJ+k0gvozLOf39XTzY+Q=="}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:24:01 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-88a5aaab-ca4d-4f81-84e1-1d108fc4f1cb tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Getting quotas for project 63b9b79fb98441fd9f1b5df54471f0bd. Resources: {'key_pairs'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:24:01 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-88a5aaab-ca4d-4f81-84e1-1d108fc4f1cb tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Getting quotas for user 88d988d9ce0a41669b7c487ac07b4cfe and project 63b9b79fb98441fd9f1b5df54471f0bd. Resources: {'key_pairs'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:24:01 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-88a5aaab-ca4d-4f81-84e1-1d108fc4f1cb tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.147976 Apr 11 15:24:01 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 68/201] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 15:24:01 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 149 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 15:24:02 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1772068587", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "15a1a586-0100-4057-8501-5c5a282d4063"}], "security_groups": [{"name": "tempest-securitygroup--2075990443"}], "key_name": "tempest-keypair-2006224467", "user_data": "}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:24:02 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:24:03 user devstack@n-api.service[61166]: DEBUG nova.network.neutron [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] validate_networks() for [('15a1a586-0100-4057-8501-5c5a282d4063', None, None, None, None, None)] {{(pid=61166) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:24:03 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-1b0b6637-3b82-492b-8534-66a0c6a635f3 req-def02f8a-b709-4799-a0c9-69b1141fe602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "068f10b4-086e-4af7-a53e-f6ece73d01e4", "name": "network-vif-plugged", "status": "completed", "tag": "7774938e-52d1-4c9a-8bc5-db84a905791b"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:24:03 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-1b0b6637-3b82-492b-8534-66a0c6a635f3 req-def02f8a-b709-4799-a0c9-69b1141fe602 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:03 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-1b0b6637-3b82-492b-8534-66a0c6a635f3 req-def02f8a-b709-4799-a0c9-69b1141fe602 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:03 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-1b0b6637-3b82-492b-8534-66a0c6a635f3 req-def02f8a-b709-4799-a0c9-69b1141fe602 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:03 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-1b0b6637-3b82-492b-8534-66a0c6a635f3 req-def02f8a-b709-4799-a0c9-69b1141fe602 service nova] Creating event network-vif-plugged:7774938e-52d1-4c9a-8bc5-db84a905791b for instance 068f10b4-086e-4af7-a53e-f6ece73d01e4 on user Apr 11 15:24:03 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-1b0b6637-3b82-492b-8534-66a0c6a635f3 req-def02f8a-b709-4799-a0c9-69b1141fe602 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054633 Apr 11 15:24:03 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 68/202] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:24:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:24:03 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Flavor limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:24:03 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Image limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:24:03 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Flavor pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:24:03 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Image pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:24:03 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:24:03 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:03 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:03 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:03 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:03 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:03 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:03 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Getting quotas for project 63b9b79fb98441fd9f1b5df54471f0bd. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:24:03 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Getting quotas for user 88d988d9ce0a41669b7c487ac07b4cfe and project 63b9b79fb98441fd9f1b5df54471f0bd. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:24:03 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Going to run 1 instances... {{(pid=61166) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:24:03 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52fe638c-5ada-47d5-b376-233bfa808a37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:24:03 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.689388 Apr 11 15:24:03 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 67/203] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 15:24:02 2023] POST /compute/v2.1/servers => generated 400 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 15:24:03 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-50df82ee-88cf-43c0-9ded-d8e127e5bd1a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:24:03 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-50df82ee-88cf-43c0-9ded-d8e127e5bd1a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:24:03 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-50df82ee-88cf-43c0-9ded-d8e127e5bd1a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:24:03 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-50df82ee-88cf-43c0-9ded-d8e127e5bd1a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:24:03 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-50df82ee-88cf-43c0-9ded-d8e127e5bd1a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:24:03 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-50df82ee-88cf-43c0-9ded-d8e127e5bd1a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" status: 200 len: 1276 microversion: 2.20 time: 0.068738 Apr 11 15:24:03 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 69/204] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:24:03 2023] GET /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d => generated 1276 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:24:05 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-2aee0eac-f75e-46dc-a71d-e5d1b5be9196 req-dc2b8933-5ca7-43dc-863d-fe2868abb5a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "068f10b4-086e-4af7-a53e-f6ece73d01e4", "name": "network-vif-plugged", "status": "completed", "tag": "7774938e-52d1-4c9a-8bc5-db84a905791b"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:24:05 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-2aee0eac-f75e-46dc-a71d-e5d1b5be9196 req-dc2b8933-5ca7-43dc-863d-fe2868abb5a3 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:05 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-2aee0eac-f75e-46dc-a71d-e5d1b5be9196 req-dc2b8933-5ca7-43dc-863d-fe2868abb5a3 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:05 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-2aee0eac-f75e-46dc-a71d-e5d1b5be9196 req-dc2b8933-5ca7-43dc-863d-fe2868abb5a3 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:05 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-2aee0eac-f75e-46dc-a71d-e5d1b5be9196 req-dc2b8933-5ca7-43dc-863d-fe2868abb5a3 service nova] Creating event network-vif-plugged:7774938e-52d1-4c9a-8bc5-db84a905791b for instance 068f10b4-086e-4af7-a53e-f6ece73d01e4 on user Apr 11 15:24:05 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-2aee0eac-f75e-46dc-a71d-e5d1b5be9196 req-dc2b8933-5ca7-43dc-863d-fe2868abb5a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036575 Apr 11 15:24:05 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 69/205] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:24:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:24:06 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-ca06187a-6ac5-4fc0-9ee7-df48ced09813 req-9c686669-86ea-49ad-8601-a0291b7c2f32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d", "tag": "1ad8234a-3f96-43a0-9dea-862e6efcda73"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:24:06 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-ca06187a-6ac5-4fc0-9ee7-df48ced09813 req-9c686669-86ea-49ad-8601-a0291b7c2f32 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:06 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-ca06187a-6ac5-4fc0-9ee7-df48ced09813 req-9c686669-86ea-49ad-8601-a0291b7c2f32 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:06 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-ca06187a-6ac5-4fc0-9ee7-df48ced09813 req-9c686669-86ea-49ad-8601-a0291b7c2f32 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:06 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-ca06187a-6ac5-4fc0-9ee7-df48ced09813 req-9c686669-86ea-49ad-8601-a0291b7c2f32 service nova] Creating event network-changed:1ad8234a-3f96-43a0-9dea-862e6efcda73 for instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d on user Apr 11 15:24:06 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-ca06187a-6ac5-4fc0-9ee7-df48ced09813 req-9c686669-86ea-49ad-8601-a0291b7c2f32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106598 Apr 11 15:24:06 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 68/206] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:24:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:24:07 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:24:07 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=30 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:24:07 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-1c595469-b498-49ca-9186-e59b2fcde567 req-d8c86e5d-5d70-48d7-8eda-ea12a1dfafb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d90fd2-6a95-43c4-8756-e82071d99154", "name": "network-vif-plugged", "status": "completed", "tag": "4718fa68-0eb9-4592-8c43-981438e3d0b8"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:24:07 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-1c595469-b498-49ca-9186-e59b2fcde567 req-d8c86e5d-5d70-48d7-8eda-ea12a1dfafb6 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:07 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-1c595469-b498-49ca-9186-e59b2fcde567 req-d8c86e5d-5d70-48d7-8eda-ea12a1dfafb6 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:07 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-1c595469-b498-49ca-9186-e59b2fcde567 req-d8c86e5d-5d70-48d7-8eda-ea12a1dfafb6 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:07 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-1c595469-b498-49ca-9186-e59b2fcde567 req-d8c86e5d-5d70-48d7-8eda-ea12a1dfafb6 service nova] Creating event network-vif-plugged:4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance b0d90fd2-6a95-43c4-8756-e82071d99154 on user Apr 11 15:24:07 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-1c595469-b498-49ca-9186-e59b2fcde567 req-d8c86e5d-5d70-48d7-8eda-ea12a1dfafb6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039538 Apr 11 15:24:07 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 70/207] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:24:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:24:09 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-31de49af-2ee3-4b87-852d-5660c741f86b req-dfec4518-190b-411b-adbc-9ec8b09c1622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d90fd2-6a95-43c4-8756-e82071d99154", "name": "network-vif-plugged", "status": "completed", "tag": "4718fa68-0eb9-4592-8c43-981438e3d0b8"}, {"server_uuid": "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d", "name": "network-vif-plugged", "status": "completed", "tag": "1ad8234a-3f96-43a0-9dea-862e6efcda73"}, {"server_uuid": "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d", "name": "network-vif-plugged", "status": "completed", "tag": "1ad8234a-3f96-43a0-9dea-862e6efcda73"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:24:09 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-31de49af-2ee3-4b87-852d-5660c741f86b req-dfec4518-190b-411b-adbc-9ec8b09c1622 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:09 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-31de49af-2ee3-4b87-852d-5660c741f86b req-dfec4518-190b-411b-adbc-9ec8b09c1622 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:09 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-31de49af-2ee3-4b87-852d-5660c741f86b req-dfec4518-190b-411b-adbc-9ec8b09c1622 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:09 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-31de49af-2ee3-4b87-852d-5660c741f86b req-dfec4518-190b-411b-adbc-9ec8b09c1622 service nova] Creating event network-vif-plugged:4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance b0d90fd2-6a95-43c4-8756-e82071d99154 on user Apr 11 15:24:09 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-31de49af-2ee3-4b87-852d-5660c741f86b req-dfec4518-190b-411b-adbc-9ec8b09c1622 service nova] Creating event network-vif-plugged:1ad8234a-3f96-43a0-9dea-862e6efcda73 for instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d on user Apr 11 15:24:09 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-31de49af-2ee3-4b87-852d-5660c741f86b req-dfec4518-190b-411b-adbc-9ec8b09c1622 service nova] Creating event network-vif-plugged:1ad8234a-3f96-43a0-9dea-862e6efcda73 for instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d on user Apr 11 15:24:09 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-31de49af-2ee3-4b87-852d-5660c741f86b req-dfec4518-190b-411b-adbc-9ec8b09c1622 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.035264 Apr 11 15:24:09 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 70/208] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:24:09 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:24:13 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-85ade214-f0f3-4417-b6a4-b09fc15b9233 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:24:13 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-85ade214-f0f3-4417-b6a4-b09fc15b9233 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:24:13 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:24:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-85ade214-f0f3-4417-b6a4-b09fc15b9233 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-85ade214-f0f3-4417-b6a4-b09fc15b9233 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-85ade214-f0f3-4417-b6a4-b09fc15b9233 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-85ade214-f0f3-4417-b6a4-b09fc15b9233 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-85ade214-f0f3-4417-b6a4-b09fc15b9233 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-85ade214-f0f3-4417-b6a4-b09fc15b9233 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:13 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=40,nova_cell1:INSERT=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:24:13 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:24:13 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=14 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:24:13 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-85ade214-f0f3-4417-b6a4-b09fc15b9233 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3a06747-0f43-4731-87e6-40629c382a6b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077909 Apr 11 15:24:13 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 69/209] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:24:13 2023] GET /compute/v2.1/servers/f3a06747-0f43-4731-87e6-40629c382a6b/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 15:24:13 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=14 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:24:13 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1391795375", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "networks": [{"uuid": "f52bd4a9-1843-408b-85af-c2124ad01be7"}]}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:24:13 user devstack@n-api.service[61167]: DEBUG nova.network.neutron [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] validate_networks() for [('f52bd4a9-1843-408b-85af-c2124ad01be7', None, None, None, None, None)] {{(pid=61167) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:24:14 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Flavor limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:24:14 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Image limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:24:14 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-82b9b5be-895d-47dc-8842-eb11fef6b288 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:24:14 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Flavor pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:24:14 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Image pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:24:14 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-82b9b5be-895d-47dc-8842-eb11fef6b288 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:24:14 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:24:14 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-82b9b5be-895d-47dc-8842-eb11fef6b288 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:14 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-82b9b5be-895d-47dc-8842-eb11fef6b288 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:14 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-82b9b5be-895d-47dc-8842-eb11fef6b288 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:14 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-82b9b5be-895d-47dc-8842-eb11fef6b288 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:14 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:14 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-82b9b5be-895d-47dc-8842-eb11fef6b288 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:14 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-82b9b5be-895d-47dc-8842-eb11fef6b288 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:14 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:14 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:14 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:14 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:14 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:14 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-82b9b5be-895d-47dc-8842-eb11fef6b288 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] HTTP exception thrown: Instance 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea could not be found. Apr 11 15:24:14 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-82b9b5be-895d-47dc-8842-eb11fef6b288 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Request method failure captured: Apr 11 15:24:14 user devstack@n-api.service[61165]: request: GET /compute/v2.1/servers/3bd4e3ea-2df2-48f8-96bd-8f8219c73bea HTTP/1.1 Apr 11 15:24:14 user devstack@n-api.service[61165]: Accept: application/json Apr 11 15:24:14 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 15:24:14 user devstack@n-api.service[61165]: Connection: close Apr 11 15:24:14 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 15:24:14 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 15:24:14 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 15:24:14 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 15:24:14 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 15:24:14 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNXr4qqSHLf2aPRyCNrd3MuqJqYD9xDTUfiyh9VprQ1q-AAM1dSQs-wU_LfN_cY5NfPvLYyO2TPTW0DpBDGN1a5ExCwUUZWASk8RRMuVVF0z4DhKPFutqKoApREujym_mXNU28Z_Jz6cRzLkrqPKJinfZydhzRXQs7xtKqPTISzSjxLg Apr 11 15:24:14 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 15:24:14 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 15:24:14 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 15:24:14 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 15:24:14 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 15:24:14 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 15:24:14 user devstack@n-api.service[61165]: X-Project-Id: 6abbfac8ab124b919978b9085a958d4b Apr 11 15:24:14 user devstack@n-api.service[61165]: X-Project-Name: tempest-VolumesNegativeTest-1341935232 Apr 11 15:24:14 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 15:24:14 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 15:24:14 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6abbfac8ab124b919978b9085a958d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6abbfac8ab124b919978b9085a958d4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6abbfac8ab124b919978b9085a958d4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:24:14 user devstack@n-api.service[61165]: X-Tenant: tempest-VolumesNegativeTest-1341935232 Apr 11 15:24:14 user devstack@n-api.service[61165]: X-Tenant-Id: 6abbfac8ab124b919978b9085a958d4b Apr 11 15:24:14 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-VolumesNegativeTest-1341935232 Apr 11 15:24:14 user devstack@n-api.service[61165]: X-User: tempest-VolumesNegativeTest-1341935232-project-member Apr 11 15:24:14 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 15:24:14 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 15:24:14 user devstack@n-api.service[61165]: X-User-Id: dacdf9131d93415596e40cb8a5416137 Apr 11 15:24:14 user devstack@n-api.service[61165]: X-User-Name: tempest-VolumesNegativeTest-1341935232-project-member Apr 11 15:24:14 user devstack@n-api.service[61165]: method: > Apr 11 15:24:14 user devstack@n-api.service[61165]: exception: Instance 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea could not be found. Apr 11 15:24:14 user devstack@n-api.service[61165]: action_args: {'id': '3bd4e3ea-2df2-48f8-96bd-8f8219c73bea'} Apr 11 15:24:14 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea could not be found. Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea could not be found. Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea could not be found. Apr 11 15:24:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:24:14 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-82b9b5be-895d-47dc-8842-eb11fef6b288 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Returning 404 to user: Instance 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:24:14 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-82b9b5be-895d-47dc-8842-eb11fef6b288 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3bd4e3ea-2df2-48f8-96bd-8f8219c73bea" status: 404 len: 111 microversion: 2.1 time: 0.029890 Apr 11 15:24:14 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 71/210] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:24:14 2023] GET /compute/v2.1/servers/3bd4e3ea-2df2-48f8-96bd-8f8219c73bea => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:24:14 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Getting quotas for project da140971126a4d298ff718275e7a22ec. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:24:14 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Getting quotas for user 2717e456dcc941899c48c3c973083bd4 and project da140971126a4d298ff718275e7a22ec. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:24:14 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Going to run 1 instances... {{(pid=61167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:24:14 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52fe638c-5ada-47d5-b376-233bfa808a37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:24:14 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.514045 Apr 11 15:24:14 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 71/211] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 15:24:13 2023] POST /compute/v2.1/servers => generated 378 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 11 15:24:14 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-90b91651-8dac-4879-9014-802882c822e6 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:24:14 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-90b91651-8dac-4879-9014-802882c822e6 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:24:14 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-90b91651-8dac-4879-9014-802882c822e6 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2717e456dcc941899c48c3c973083bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da140971126a4d298ff718275e7a22ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:24:14 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-90b91651-8dac-4879-9014-802882c822e6 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b59399aa-f550-41c7-9818-6cb1f271fb52" status: 200 len: 1212 microversion: 2.1 time: 0.084733 Apr 11 15:24:14 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 70/212] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:24:14 2023] GET /compute/v2.1/servers/b59399aa-f550-41c7-9818-6cb1f271fb52 => generated 1212 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:24:16 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-9c43402e-e62e-4195-9bb6-3bb44bd2320c req-f5eeeecc-95fe-45c1-ba95-62f3594b118a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b59399aa-f550-41c7-9818-6cb1f271fb52", "tag": "ae63c1ed-23df-4140-979f-1756e27a67e1"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:24:16 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:24:16 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-9c43402e-e62e-4195-9bb6-3bb44bd2320c req-f5eeeecc-95fe-45c1-ba95-62f3594b118a service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:16 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-9c43402e-e62e-4195-9bb6-3bb44bd2320c req-f5eeeecc-95fe-45c1-ba95-62f3594b118a service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:16 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-9c43402e-e62e-4195-9bb6-3bb44bd2320c req-f5eeeecc-95fe-45c1-ba95-62f3594b118a service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:16 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:24:16 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-9c43402e-e62e-4195-9bb6-3bb44bd2320c req-f5eeeecc-95fe-45c1-ba95-62f3594b118a service nova] Creating event network-changed:ae63c1ed-23df-4140-979f-1756e27a67e1 for instance b59399aa-f550-41c7-9818-6cb1f271fb52 on user Apr 11 15:24:16 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-9c43402e-e62e-4195-9bb6-3bb44bd2320c req-f5eeeecc-95fe-45c1-ba95-62f3594b118a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043353 Apr 11 15:24:16 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 72/213] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:24:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:24:19 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-347fa1bd-c4bc-4d05-a77a-0cf41d62ce36 req-e2ba6280-03c6-4e90-ba6f-8cd31d230d6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b59399aa-f550-41c7-9818-6cb1f271fb52", "name": "network-vif-plugged", "status": "completed", "tag": "ae63c1ed-23df-4140-979f-1756e27a67e1"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:24:19 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=7 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:24:19 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-347fa1bd-c4bc-4d05-a77a-0cf41d62ce36 req-e2ba6280-03c6-4e90-ba6f-8cd31d230d6e service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:19 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-347fa1bd-c4bc-4d05-a77a-0cf41d62ce36 req-e2ba6280-03c6-4e90-ba6f-8cd31d230d6e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:19 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-347fa1bd-c4bc-4d05-a77a-0cf41d62ce36 req-e2ba6280-03c6-4e90-ba6f-8cd31d230d6e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:19 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-347fa1bd-c4bc-4d05-a77a-0cf41d62ce36 req-e2ba6280-03c6-4e90-ba6f-8cd31d230d6e service nova] Creating event network-vif-plugged:ae63c1ed-23df-4140-979f-1756e27a67e1 for instance b59399aa-f550-41c7-9818-6cb1f271fb52 on user Apr 11 15:24:19 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-347fa1bd-c4bc-4d05-a77a-0cf41d62ce36 req-e2ba6280-03c6-4e90-ba6f-8cd31d230d6e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056364 Apr 11 15:24:19 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 72/214] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:24:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:24:21 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-a1feed28-09ba-494b-ad15-a7c215493426 req-ccbebfce-515f-4971-8abb-463a5a8f64b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b59399aa-f550-41c7-9818-6cb1f271fb52", "name": "network-vif-plugged", "status": "completed", "tag": "ae63c1ed-23df-4140-979f-1756e27a67e1"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:24:21 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-a1feed28-09ba-494b-ad15-a7c215493426 req-ccbebfce-515f-4971-8abb-463a5a8f64b0 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:21 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-a1feed28-09ba-494b-ad15-a7c215493426 req-ccbebfce-515f-4971-8abb-463a5a8f64b0 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:21 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-a1feed28-09ba-494b-ad15-a7c215493426 req-ccbebfce-515f-4971-8abb-463a5a8f64b0 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:21 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-a1feed28-09ba-494b-ad15-a7c215493426 req-ccbebfce-515f-4971-8abb-463a5a8f64b0 service nova] Creating event network-vif-plugged:ae63c1ed-23df-4140-979f-1756e27a67e1 for instance b59399aa-f550-41c7-9818-6cb1f271fb52 on user Apr 11 15:24:21 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-a1feed28-09ba-494b-ad15-a7c215493426 req-ccbebfce-515f-4971-8abb-463a5a8f64b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042496 Apr 11 15:24:21 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 71/215] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:24:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 15:24:22 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-f96ab697-a45e-41b4-b83b-e3f2898ed1ff tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:24:22 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-f96ab697-a45e-41b4-b83b-e3f2898ed1ff tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:24:22 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-f96ab697-a45e-41b4-b83b-e3f2898ed1ff tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:22 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-f96ab697-a45e-41b4-b83b-e3f2898ed1ff tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:22 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-f96ab697-a45e-41b4-b83b-e3f2898ed1ff tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:22 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-f96ab697-a45e-41b4-b83b-e3f2898ed1ff tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:22 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-f96ab697-a45e-41b4-b83b-e3f2898ed1ff tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:22 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-f96ab697-a45e-41b4-b83b-e3f2898ed1ff tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:22 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-f96ab697-a45e-41b4-b83b-e3f2898ed1ff tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] HTTP exception thrown: Instance 2b2c294d-49b2-41bf-89d0-17a560e7741f could not be found. Apr 11 15:24:22 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-f96ab697-a45e-41b4-b83b-e3f2898ed1ff tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Request method failure captured: Apr 11 15:24:22 user devstack@n-api.service[61165]: request: GET /compute/v2.1/servers/2b2c294d-49b2-41bf-89d0-17a560e7741f HTTP/1.1 Apr 11 15:24:22 user devstack@n-api.service[61165]: Accept: application/json Apr 11 15:24:22 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 15:24:22 user devstack@n-api.service[61165]: Connection: close Apr 11 15:24:22 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 15:24:22 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 15:24:22 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 15:24:22 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 15:24:22 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 15:24:22 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNXrbEXrGhMb4_2AH6UGvgiPe2XaCaQ68H0jC4C8lN29fqDhrJjArTxJPsmmz2m-8o-xTkdm76juqL-c3tu8y2z74fJLjo0Ezy02ac6HMim39mBP7ULjPrK4POzp08QNFL5nC82mn0eiCYRieJdn6Bv5_ALQKRsb3-4ynWCcIxH6AkqE Apr 11 15:24:22 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 15:24:22 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 15:24:22 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 15:24:22 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 15:24:22 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 15:24:22 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 15:24:22 user devstack@n-api.service[61165]: X-Project-Id: 7e67f7203b1849c0af305f88ad8284f9 Apr 11 15:24:22 user devstack@n-api.service[61165]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-19713134 Apr 11 15:24:22 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 15:24:22 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 15:24:22 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7e67f7203b1849c0af305f88ad8284f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7e67f7203b1849c0af305f88ad8284f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7e67f7203b1849c0af305f88ad8284f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:24:22 user devstack@n-api.service[61165]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-19713134 Apr 11 15:24:22 user devstack@n-api.service[61165]: X-Tenant-Id: 7e67f7203b1849c0af305f88ad8284f9 Apr 11 15:24:22 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-19713134 Apr 11 15:24:22 user devstack@n-api.service[61165]: X-User: tempest-AttachSCSIVolumeTestJSON-19713134-project-member Apr 11 15:24:22 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 15:24:22 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 15:24:22 user devstack@n-api.service[61165]: X-User-Id: cab8ba2ebb8643a59d3a8a821cd1c2f1 Apr 11 15:24:22 user devstack@n-api.service[61165]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-19713134-project-member Apr 11 15:24:22 user devstack@n-api.service[61165]: method: > Apr 11 15:24:22 user devstack@n-api.service[61165]: exception: Instance 2b2c294d-49b2-41bf-89d0-17a560e7741f could not be found. Apr 11 15:24:22 user devstack@n-api.service[61165]: action_args: {'id': '2b2c294d-49b2-41bf-89d0-17a560e7741f'} Apr 11 15:24:22 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b2c294d-49b2-41bf-89d0-17a560e7741f could not be found. Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b2c294d-49b2-41bf-89d0-17a560e7741f could not be found. Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b2c294d-49b2-41bf-89d0-17a560e7741f could not be found. Apr 11 15:24:22 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:24:22 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-f96ab697-a45e-41b4-b83b-e3f2898ed1ff tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Returning 404 to user: Instance 2b2c294d-49b2-41bf-89d0-17a560e7741f could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:24:22 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-f96ab697-a45e-41b4-b83b-e3f2898ed1ff tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2b2c294d-49b2-41bf-89d0-17a560e7741f" status: 404 len: 111 microversion: 2.1 time: 0.131385 Apr 11 15:24:22 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 73/216] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:24:22 2023] GET /compute/v2.1/servers/2b2c294d-49b2-41bf-89d0-17a560e7741f => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:24:22 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-c1487406-8e56-43bc-9cea-444003f80476 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Calling method '.version_select at 0x7f4c2ef78f70>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:24:22 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-c1487406-8e56-43bc-9cea-444003f80476 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1093697918" status: 202 len: 0 microversion: 2.1 time: 0.024593 Apr 11 15:24:22 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 73/217] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 15:24:22 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1093697918 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 11 15:24:25 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:24:25 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-5a41cebd-9161-44cb-9fc8-98f641c8a403 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:24:25 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-5a41cebd-9161-44cb-9fc8-98f641c8a403 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:24:25 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-5a41cebd-9161-44cb-9fc8-98f641c8a403 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:25 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-5a41cebd-9161-44cb-9fc8-98f641c8a403 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:25 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-5a41cebd-9161-44cb-9fc8-98f641c8a403 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:25 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-5a41cebd-9161-44cb-9fc8-98f641c8a403 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:25 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-5a41cebd-9161-44cb-9fc8-98f641c8a403 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:25 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-5a41cebd-9161-44cb-9fc8-98f641c8a403 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:25 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-5a41cebd-9161-44cb-9fc8-98f641c8a403 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] HTTP exception thrown: Instance 2b2c294d-49b2-41bf-89d0-17a560e7741f could not be found. Apr 11 15:24:25 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-5a41cebd-9161-44cb-9fc8-98f641c8a403 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Request method failure captured: Apr 11 15:24:25 user devstack@n-api.service[61166]: request: DELETE /compute/v2.1/servers/2b2c294d-49b2-41bf-89d0-17a560e7741f HTTP/1.1 Apr 11 15:24:25 user devstack@n-api.service[61166]: Accept: application/json Apr 11 15:24:25 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 15:24:25 user devstack@n-api.service[61166]: Connection: close Apr 11 15:24:25 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 15:24:25 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 15:24:25 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 15:24:25 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 15:24:25 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 15:24:25 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNXrbEXrGhMb4_2AH6UGvgiPe2XaCaQ68H0jC4C8lN29fqDhrJjArTxJPsmmz2m-8o-xTkdm76juqL-c3tu8y2z74fJLjo0Ezy02ac6HMim39mBP7ULjPrK4POzp08QNFL5nC82mn0eiCYRieJdn6Bv5_ALQKRsb3-4ynWCcIxH6AkqE Apr 11 15:24:25 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 15:24:25 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 15:24:25 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 15:24:25 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 15:24:25 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 15:24:25 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 15:24:25 user devstack@n-api.service[61166]: X-Project-Id: 7e67f7203b1849c0af305f88ad8284f9 Apr 11 15:24:25 user devstack@n-api.service[61166]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-19713134 Apr 11 15:24:25 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 15:24:25 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 15:24:25 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7e67f7203b1849c0af305f88ad8284f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7e67f7203b1849c0af305f88ad8284f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7e67f7203b1849c0af305f88ad8284f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:24:25 user devstack@n-api.service[61166]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-19713134 Apr 11 15:24:25 user devstack@n-api.service[61166]: X-Tenant-Id: 7e67f7203b1849c0af305f88ad8284f9 Apr 11 15:24:25 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-19713134 Apr 11 15:24:25 user devstack@n-api.service[61166]: X-User: tempest-AttachSCSIVolumeTestJSON-19713134-project-member Apr 11 15:24:25 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 15:24:25 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 15:24:25 user devstack@n-api.service[61166]: X-User-Id: cab8ba2ebb8643a59d3a8a821cd1c2f1 Apr 11 15:24:25 user devstack@n-api.service[61166]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-19713134-project-member Apr 11 15:24:25 user devstack@n-api.service[61166]: method: > Apr 11 15:24:25 user devstack@n-api.service[61166]: exception: Instance 2b2c294d-49b2-41bf-89d0-17a560e7741f could not be found. Apr 11 15:24:25 user devstack@n-api.service[61166]: action_args: {'id': '2b2c294d-49b2-41bf-89d0-17a560e7741f'} Apr 11 15:24:25 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b2c294d-49b2-41bf-89d0-17a560e7741f could not be found. Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b2c294d-49b2-41bf-89d0-17a560e7741f could not be found. Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b2c294d-49b2-41bf-89d0-17a560e7741f could not be found. Apr 11 15:24:25 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:24:25 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-5a41cebd-9161-44cb-9fc8-98f641c8a403 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Returning 404 to user: Instance 2b2c294d-49b2-41bf-89d0-17a560e7741f could not be found. {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:24:25 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-5a41cebd-9161-44cb-9fc8-98f641c8a403 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2b2c294d-49b2-41bf-89d0-17a560e7741f" status: 404 len: 111 microversion: 2.1 time: 0.051850 Apr 11 15:24:25 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 72/218] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:24:25 2023] DELETE /compute/v2.1/servers/2b2c294d-49b2-41bf-89d0-17a560e7741f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:24:25 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-7346369a-145c-4017-afc4-86507b285813 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:24:25 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-7346369a-145c-4017-afc4-86507b285813 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:24:25 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7346369a-145c-4017-afc4-86507b285813 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:25 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7346369a-145c-4017-afc4-86507b285813 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:25 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7346369a-145c-4017-afc4-86507b285813 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:25 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7346369a-145c-4017-afc4-86507b285813 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:25 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7346369a-145c-4017-afc4-86507b285813 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:25 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7346369a-145c-4017-afc4-86507b285813 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:25 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-7346369a-145c-4017-afc4-86507b285813 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] HTTP exception thrown: Instance 2b2c294d-49b2-41bf-89d0-17a560e7741f could not be found. Apr 11 15:24:25 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-7346369a-145c-4017-afc4-86507b285813 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Request method failure captured: Apr 11 15:24:25 user devstack@n-api.service[61165]: request: GET /compute/v2.1/servers/2b2c294d-49b2-41bf-89d0-17a560e7741f HTTP/1.1 Apr 11 15:24:25 user devstack@n-api.service[61165]: Accept: application/json Apr 11 15:24:25 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 15:24:25 user devstack@n-api.service[61165]: Connection: close Apr 11 15:24:25 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 15:24:25 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 15:24:25 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 15:24:25 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 15:24:25 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 15:24:25 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNXrbEXrGhMb4_2AH6UGvgiPe2XaCaQ68H0jC4C8lN29fqDhrJjArTxJPsmmz2m-8o-xTkdm76juqL-c3tu8y2z74fJLjo0Ezy02ac6HMim39mBP7ULjPrK4POzp08QNFL5nC82mn0eiCYRieJdn6Bv5_ALQKRsb3-4ynWCcIxH6AkqE Apr 11 15:24:25 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 15:24:25 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 15:24:25 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 15:24:25 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 15:24:25 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 15:24:25 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 15:24:25 user devstack@n-api.service[61165]: X-Project-Id: 7e67f7203b1849c0af305f88ad8284f9 Apr 11 15:24:25 user devstack@n-api.service[61165]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-19713134 Apr 11 15:24:25 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 15:24:25 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 15:24:25 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7e67f7203b1849c0af305f88ad8284f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7e67f7203b1849c0af305f88ad8284f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7e67f7203b1849c0af305f88ad8284f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:24:25 user devstack@n-api.service[61165]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-19713134 Apr 11 15:24:25 user devstack@n-api.service[61165]: X-Tenant-Id: 7e67f7203b1849c0af305f88ad8284f9 Apr 11 15:24:25 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-19713134 Apr 11 15:24:25 user devstack@n-api.service[61165]: X-User: tempest-AttachSCSIVolumeTestJSON-19713134-project-member Apr 11 15:24:25 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 15:24:25 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 15:24:25 user devstack@n-api.service[61165]: X-User-Id: cab8ba2ebb8643a59d3a8a821cd1c2f1 Apr 11 15:24:25 user devstack@n-api.service[61165]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-19713134-project-member Apr 11 15:24:25 user devstack@n-api.service[61165]: method: > Apr 11 15:24:25 user devstack@n-api.service[61165]: exception: Instance 2b2c294d-49b2-41bf-89d0-17a560e7741f could not be found. Apr 11 15:24:25 user devstack@n-api.service[61165]: action_args: {'id': '2b2c294d-49b2-41bf-89d0-17a560e7741f'} Apr 11 15:24:25 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b2c294d-49b2-41bf-89d0-17a560e7741f could not be found. Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b2c294d-49b2-41bf-89d0-17a560e7741f could not be found. Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b2c294d-49b2-41bf-89d0-17a560e7741f could not be found. Apr 11 15:24:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:24:25 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-7346369a-145c-4017-afc4-86507b285813 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Returning 404 to user: Instance 2b2c294d-49b2-41bf-89d0-17a560e7741f could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:24:25 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-7346369a-145c-4017-afc4-86507b285813 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2b2c294d-49b2-41bf-89d0-17a560e7741f" status: 404 len: 111 microversion: 2.1 time: 0.044950 Apr 11 15:24:25 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 74/219] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:24:25 2023] GET /compute/v2.1/servers/2b2c294d-49b2-41bf-89d0-17a560e7741f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:24:35 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:24:35 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:24:35 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:24:35 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:24:35 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-46c095db-c9f3-41c8-a3a4-66bd7de56dd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:24:35 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-46c095db-c9f3-41c8-a3a4-66bd7de56dd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:24:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-46c095db-c9f3-41c8-a3a4-66bd7de56dd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-46c095db-c9f3-41c8-a3a4-66bd7de56dd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-46c095db-c9f3-41c8-a3a4-66bd7de56dd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-46c095db-c9f3-41c8-a3a4-66bd7de56dd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-46c095db-c9f3-41c8-a3a4-66bd7de56dd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-46c095db-c9f3-41c8-a3a4-66bd7de56dd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:35 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-46c095db-c9f3-41c8-a3a4-66bd7de56dd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d84862f-b710-48b1-9275-93fc799cf1f9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050199 Apr 11 15:24:35 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 74/220] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:24:35 2023] GET /compute/v2.1/servers/8d84862f-b710-48b1-9275-93fc799cf1f9/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 15:24:35 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:24:35 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:24:35 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=9 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:24:35 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=9 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:24:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:35 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Going to try to terminate instance {{(pid=61166) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:24:35 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8d84862f-b710-48b1-9275-93fc799cf1f9" status: 204 len: 0 microversion: 2.1 time: 0.130975 Apr 11 15:24:35 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 73/221] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:24:35 2023] DELETE /compute/v2.1/servers/8d84862f-b710-48b1-9275-93fc799cf1f9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:24:35 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-170aca5a-d0f5-45ab-a4ec-f601fdc90519 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:24:35 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-170aca5a-d0f5-45ab-a4ec-f601fdc90519 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:24:35 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=5 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:24:35 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=5 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:24:35 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-170aca5a-d0f5-45ab-a4ec-f601fdc90519 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:35 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-170aca5a-d0f5-45ab-a4ec-f601fdc90519 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:35 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-170aca5a-d0f5-45ab-a4ec-f601fdc90519 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:35 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-170aca5a-d0f5-45ab-a4ec-f601fdc90519 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:35 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-170aca5a-d0f5-45ab-a4ec-f601fdc90519 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:35 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-170aca5a-d0f5-45ab-a4ec-f601fdc90519 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:36 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-170aca5a-d0f5-45ab-a4ec-f601fdc90519 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ec75db561b4fec903a1a391c3d03e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c88bf2782342c8af04195140d6cd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:24:36 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-170aca5a-d0f5-45ab-a4ec-f601fdc90519 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d84862f-b710-48b1-9275-93fc799cf1f9" status: 200 len: 1651 microversion: 2.1 time: 0.198237 Apr 11 15:24:36 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 75/222] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:24:35 2023] GET /compute/v2.1/servers/8d84862f-b710-48b1-9275-93fc799cf1f9 => generated 1651 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:24:36 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-962fcfcc-9cee-468e-abd8-ff3399bca84c req-67a2a6a6-68e2-44c8-b6ac-803b50d56416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d84862f-b710-48b1-9275-93fc799cf1f9", "name": "network-vif-unplugged", "status": "completed", "tag": "bcba48c0-9931-4249-925c-57cb387499d1"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:24:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-962fcfcc-9cee-468e-abd8-ff3399bca84c req-67a2a6a6-68e2-44c8-b6ac-803b50d56416 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-962fcfcc-9cee-468e-abd8-ff3399bca84c req-67a2a6a6-68e2-44c8-b6ac-803b50d56416 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-962fcfcc-9cee-468e-abd8-ff3399bca84c req-67a2a6a6-68e2-44c8-b6ac-803b50d56416 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:36 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-962fcfcc-9cee-468e-abd8-ff3399bca84c req-67a2a6a6-68e2-44c8-b6ac-803b50d56416 service nova] Creating event network-vif-unplugged:bcba48c0-9931-4249-925c-57cb387499d1 for instance 8d84862f-b710-48b1-9275-93fc799cf1f9 on user Apr 11 15:24:36 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-962fcfcc-9cee-468e-abd8-ff3399bca84c req-67a2a6a6-68e2-44c8-b6ac-803b50d56416 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037917 Apr 11 15:24:36 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 75/223] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:24:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:24:36 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-29908a82-80c2-48ff-956e-bda87387500b tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:24:36 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-29908a82-80c2-48ff-956e-bda87387500b tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:24:36 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-29908a82-80c2-48ff-956e-bda87387500b tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:36 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-29908a82-80c2-48ff-956e-bda87387500b tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:36 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-29908a82-80c2-48ff-956e-bda87387500b tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:36 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-29908a82-80c2-48ff-956e-bda87387500b tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:36 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-29908a82-80c2-48ff-956e-bda87387500b tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:36 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-29908a82-80c2-48ff-956e-bda87387500b tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:36 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-29908a82-80c2-48ff-956e-bda87387500b tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] HTTP exception thrown: Instance cda43d26-e2f7-4e86-b850-b914957c9b57 could not be found. Apr 11 15:24:36 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-29908a82-80c2-48ff-956e-bda87387500b tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Request method failure captured: Apr 11 15:24:36 user devstack@n-api.service[61166]: request: GET /compute/v2.1/servers/cda43d26-e2f7-4e86-b850-b914957c9b57 HTTP/1.1 Apr 11 15:24:36 user devstack@n-api.service[61166]: Accept: application/json Apr 11 15:24:36 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 15:24:36 user devstack@n-api.service[61166]: Connection: close Apr 11 15:24:36 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 15:24:36 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 15:24:36 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 15:24:36 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 15:24:36 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 15:24:36 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNXrThb-BYv4Ul1Ov2LqRaVndgDUkX9X151vZLciv3W8IFlRIzhgqfmxx9X9hSs4-q2JSCvNz_zTvnUv5O8Ss8WHE5Ih6J6UJvfrWmMLDSifASO7skoa8ZVaYxdDHnd_o5NQNhWayZRarxaRr6i1i-4qnAH_vymrHS6okJwNUIaYFjwI Apr 11 15:24:36 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 15:24:36 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 15:24:36 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 15:24:36 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 15:24:36 user devstack@n-api.service[61166]: X-Openstack-Nova-Api-Version: 2.42 Apr 11 15:24:36 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 15:24:36 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 15:24:36 user devstack@n-api.service[61166]: X-Project-Id: e64015226c19441d87f3a6999a3a8db8 Apr 11 15:24:36 user devstack@n-api.service[61166]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-441311830 Apr 11 15:24:36 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 15:24:36 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 15:24:36 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e64015226c19441d87f3a6999a3a8db8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e64015226c19441d87f3a6999a3a8db8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e64015226c19441d87f3a6999a3a8db8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:24:36 user devstack@n-api.service[61166]: X-Tenant: tempest-TaggedBootDevicesTest_v242-441311830 Apr 11 15:24:36 user devstack@n-api.service[61166]: X-Tenant-Id: e64015226c19441d87f3a6999a3a8db8 Apr 11 15:24:36 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-441311830 Apr 11 15:24:36 user devstack@n-api.service[61166]: X-User: tempest-TaggedBootDevicesTest_v242-441311830-project-member Apr 11 15:24:36 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 15:24:36 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 15:24:36 user devstack@n-api.service[61166]: X-User-Id: 31d206ed111842fd95ce5eb5b3835a48 Apr 11 15:24:36 user devstack@n-api.service[61166]: X-User-Name: tempest-TaggedBootDevicesTest_v242-441311830-project-member Apr 11 15:24:36 user devstack@n-api.service[61166]: method: > Apr 11 15:24:36 user devstack@n-api.service[61166]: exception: Instance cda43d26-e2f7-4e86-b850-b914957c9b57 could not be found. Apr 11 15:24:36 user devstack@n-api.service[61166]: action_args: {'id': 'cda43d26-e2f7-4e86-b850-b914957c9b57'} Apr 11 15:24:36 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cda43d26-e2f7-4e86-b850-b914957c9b57 could not be found. Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cda43d26-e2f7-4e86-b850-b914957c9b57 could not be found. Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cda43d26-e2f7-4e86-b850-b914957c9b57 could not be found. Apr 11 15:24:36 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:24:36 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-29908a82-80c2-48ff-956e-bda87387500b tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Returning 404 to user: Instance cda43d26-e2f7-4e86-b850-b914957c9b57 could not be found. {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:24:36 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-29908a82-80c2-48ff-956e-bda87387500b tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cda43d26-e2f7-4e86-b850-b914957c9b57" status: 404 len: 111 microversion: 2.42 time: 0.035992 Apr 11 15:24:36 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 74/224] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:24:36 2023] GET /compute/v2.1/servers/cda43d26-e2f7-4e86-b850-b914957c9b57 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 15:24:36 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-bd02229f-3378-4d35-88ae-3b468a4bfce4 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Calling method '.version_select at 0x7f4c2efa3370>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:24:36 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-bd02229f-3378-4d35-88ae-3b468a4bfce4 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1831001595" status: 204 len: 0 microversion: 2.42 time: 0.023717 Apr 11 15:24:36 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 76/225] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Apr 11 15:24:36 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1831001595 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 11 15:24:36 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-38d1778f-d036-4eec-9133-b2fc61e3e854 tempest-VolumesTestJSON-2129555819 tempest-VolumesTestJSON-2129555819-project-member] Calling method '.version_select at 0x7f4c2ef79000>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:24:36 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-38d1778f-d036-4eec-9133-b2fc61e3e854 tempest-VolumesTestJSON-2129555819 tempest-VolumesTestJSON-2129555819-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/69d39161-94ae-4396-8364-28084f3a332f" status: 200 len: 351 microversion: 2.1 time: 0.075793 Apr 11 15:24:36 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 76/226] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 15:24:36 2023] GET /compute/v2.1/os-volumes/69d39161-94ae-4396-8364-28084f3a332f => generated 351 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:24:37 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-81f81c28-e588-4bc6-b310-ca548b652493 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Action: 'create', calling method: .version_select at 0x7f4c2eff6440>, body: {"keypair": {"name": "tempest-TestShelveInstance-1630475072", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4WD1C8T6tkUEgT5nSc1MsqRgkLNzQRS7RjsK+eCmfdmidOraNTmKvDvSPnsYiAjMuo6nku/oKvPzyy026kIaVTiO+J+8OfPbwUqPSj0x0wpOl+Z+4f+Lo5uETYRrAumQ=="}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:24:37 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-81f81c28-e588-4bc6-b310-ca548b652493 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Getting quotas for project 63ed867a40534b70bf75dc0cc28fdfec. Resources: {'key_pairs'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:24:37 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-81f81c28-e588-4bc6-b310-ca548b652493 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Getting quotas for user 49e1716b2bb2438b93d46dc8052c788b and project 63ed867a40534b70bf75dc0cc28fdfec. Resources: {'key_pairs'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:24:37 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-81f81c28-e588-4bc6-b310-ca548b652493 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.256243 Apr 11 15:24:37 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 75/227] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 15:24:37 2023] POST /compute/v2.1/os-keypairs => generated 397 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:24:37 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-210090d9-908f-4e25-b465-2295e868c20a req-24c0f29b-b8ca-421c-a311-ed025b4d51d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d84862f-b710-48b1-9275-93fc799cf1f9", "name": "network-vif-deleted", "tag": "bcba48c0-9931-4249-925c-57cb387499d1"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:24:37 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-210090d9-908f-4e25-b465-2295e868c20a req-24c0f29b-b8ca-421c-a311-ed025b4d51d5 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:37 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-210090d9-908f-4e25-b465-2295e868c20a req-24c0f29b-b8ca-421c-a311-ed025b4d51d5 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:37 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-210090d9-908f-4e25-b465-2295e868c20a req-24c0f29b-b8ca-421c-a311-ed025b4d51d5 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:37 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-210090d9-908f-4e25-b465-2295e868c20a req-24c0f29b-b8ca-421c-a311-ed025b4d51d5 service nova] Creating event network-vif-deleted:bcba48c0-9931-4249-925c-57cb387499d1 for instance 8d84862f-b710-48b1-9275-93fc799cf1f9 on user Apr 11 15:24:37 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-210090d9-908f-4e25-b465-2295e868c20a req-24c0f29b-b8ca-421c-a311-ed025b4d51d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030036 Apr 11 15:24:37 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 77/228] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:24:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:24:38 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-093ab9d7-fbb1-46e1-8ee3-b072a113b677 tempest-VolumesTestJSON-2129555819 tempest-VolumesTestJSON-2129555819-project-member] Calling method '.version_select at 0x7f4c2ef7b520>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:24:38 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-093ab9d7-fbb1-46e1-8ee3-b072a113b677 tempest-VolumesTestJSON-2129555819 tempest-VolumesTestJSON-2129555819-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/cafa2374-a551-4bb8-b611-14eb803af454" status: 200 len: 350 microversion: 2.1 time: 0.061736 Apr 11 15:24:38 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 77/229] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 15:24:38 2023] GET /compute/v2.1/os-volumes/cafa2374-a551-4bb8-b611-14eb803af454 => generated 350 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:24:38 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-e4d32c9d-2dfd-4cd0-9f1e-75a457e21abb req-3cf399b8-0765-4fc0-8d45-e0d97eced22a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d84862f-b710-48b1-9275-93fc799cf1f9", "name": "network-vif-plugged", "status": "completed", "tag": "bcba48c0-9931-4249-925c-57cb387499d1"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:24:38 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-e4d32c9d-2dfd-4cd0-9f1e-75a457e21abb req-3cf399b8-0765-4fc0-8d45-e0d97eced22a service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:38 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-e4d32c9d-2dfd-4cd0-9f1e-75a457e21abb req-3cf399b8-0765-4fc0-8d45-e0d97eced22a service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:38 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-e4d32c9d-2dfd-4cd0-9f1e-75a457e21abb req-3cf399b8-0765-4fc0-8d45-e0d97eced22a service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:38 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-e4d32c9d-2dfd-4cd0-9f1e-75a457e21abb req-3cf399b8-0765-4fc0-8d45-e0d97eced22a service nova] Creating event network-vif-plugged:bcba48c0-9931-4249-925c-57cb387499d1 for instance 8d84862f-b710-48b1-9275-93fc799cf1f9 on user Apr 11 15:24:38 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-e4d32c9d-2dfd-4cd0-9f1e-75a457e21abb req-3cf399b8-0765-4fc0-8d45-e0d97eced22a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031808 Apr 11 15:24:38 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 76/230] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:24:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:24:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-af4c2aef-fba6-4453-815e-2810e92bf5c9 tempest-VolumesTestJSON-2129555819 tempest-VolumesTestJSON-2129555819-project-member] Calling method '.version_select at 0x7f4c2efa2f80>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:24:39 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-af4c2aef-fba6-4453-815e-2810e92bf5c9 tempest-VolumesTestJSON-2129555819 tempest-VolumesTestJSON-2129555819-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/09f785bc-c1b4-49c8-8b70-03c93d43ca3f" status: 200 len: 350 microversion: 2.1 time: 0.102645 Apr 11 15:24:39 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 78/231] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 15:24:39 2023] GET /compute/v2.1/os-volumes/09f785bc-c1b4-49c8-8b70-03c93d43ca3f => generated 350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:24:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-0cdb9a9c-202a-4081-afdc-1b76d3f1aa0b tempest-VolumesTestJSON-2129555819 tempest-VolumesTestJSON-2129555819-project-member] Calling method '.version_select at 0x7f4c2ef78ca0>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:24:39 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-0cdb9a9c-202a-4081-afdc-1b76d3f1aa0b tempest-VolumesTestJSON-2129555819 tempest-VolumesTestJSON-2129555819-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.104846 Apr 11 15:24:39 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 78/232] 10.0.0.210 () {62 vars in 1211 bytes} [Tue Apr 11 15:24:39 2023] GET /compute/v2.1/os-volumes => generated 1034 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:24:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-5dd17ff5-61b4-4d55-b9f4-99989bf2b958 tempest-VolumesTestJSON-2129555819 tempest-VolumesTestJSON-2129555819-project-member] Calling method '.version_select at 0x7f4c2f188e50>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:24:39 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-5dd17ff5-61b4-4d55-b9f4-99989bf2b958 tempest-VolumesTestJSON-2129555819 tempest-VolumesTestJSON-2129555819-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.094686 Apr 11 15:24:39 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 77/233] 10.0.0.210 () {62 vars in 1226 bytes} [Tue Apr 11 15:24:39 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:24:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-69828a90-460b-45a1-a9c3-ef9344c57aa0 tempest-VolumesTestJSON-2129555819 tempest-VolumesTestJSON-2129555819-project-member] Calling method '.version_select at 0x7f4c2efa3eb0>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:24:39 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-69828a90-460b-45a1-a9c3-ef9344c57aa0 tempest-VolumesTestJSON-2129555819 tempest-VolumesTestJSON-2129555819-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.116667 Apr 11 15:24:39 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 79/234] 10.0.0.210 () {62 vars in 1211 bytes} [Tue Apr 11 15:24:39 2023] GET /compute/v2.1/os-volumes => generated 1034 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:24:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-dd0ef2ae-154f-4441-97c7-7754023e9f52 tempest-VolumesTestJSON-2129555819 tempest-VolumesTestJSON-2129555819-project-member] Calling method '.version_select at 0x7f4c2ef79870>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:24:40 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-dd0ef2ae-154f-4441-97c7-7754023e9f52 tempest-VolumesTestJSON-2129555819 tempest-VolumesTestJSON-2129555819-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086185 Apr 11 15:24:40 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 79/235] 10.0.0.210 () {62 vars in 1244 bytes} [Tue Apr 11 15:24:40 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:24:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-ab18199b-6acf-4369-9b1e-72a785e05eca tempest-VolumesTestJSON-2129555819 tempest-VolumesTestJSON-2129555819-project-member] Calling method '.version_select at 0x7f4c2ee51240>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:24:40 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-ab18199b-6acf-4369-9b1e-72a785e05eca tempest-VolumesTestJSON-2129555819 tempest-VolumesTestJSON-2129555819-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.097054 Apr 11 15:24:40 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 78/236] 10.0.0.210 () {62 vars in 1247 bytes} [Tue Apr 11 15:24:40 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:24:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-ab7bfed4-ad72-4637-b8a1-be412da7bc08 tempest-VolumesTestJSON-2129555819 tempest-VolumesTestJSON-2129555819-project-member] Calling method '.version_select at 0x7f4c3054bc70>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:24:40 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-ab7bfed4-ad72-4637-b8a1-be412da7bc08 tempest-VolumesTestJSON-2129555819 tempest-VolumesTestJSON-2129555819-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.080141 Apr 11 15:24:40 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 80/237] 10.0.0.210 () {62 vars in 1232 bytes} [Tue Apr 11 15:24:40 2023] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:24:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-66de4968-8ea7-4155-8662-bdfb210a2b0e tempest-VolumesTestJSON-2129555819 tempest-VolumesTestJSON-2129555819-project-member] Calling method '.version_select at 0x7f4c307d1870>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:24:40 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-66de4968-8ea7-4155-8662-bdfb210a2b0e tempest-VolumesTestJSON-2129555819 tempest-VolumesTestJSON-2129555819-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.152910 Apr 11 15:24:40 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 80/238] 10.0.0.210 () {62 vars in 1265 bytes} [Tue Apr 11 15:24:40 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:24:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-27a76ea7-f5bf-4d20-a4ef-ac12ac476825 tempest-VolumesTestJSON-2129555819 tempest-VolumesTestJSON-2129555819-project-member] Calling method '.version_select at 0x7f4c2eff7520>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:24:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2037395852", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-1630475072", "security_groups": [{"name": "tempest-secgroup-smoke-1141744187"}], "networks": [{"uuid": "75a41a6a-1c7b-47b0-907e-2015d56f554e"}], "block_device_mapping_v2": [{"uuid": "3132ad02-1f63-469b-b802-d814466b9ad7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:24:40 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-27a76ea7-f5bf-4d20-a4ef-ac12ac476825 tempest-VolumesTestJSON-2129555819 tempest-VolumesTestJSON-2129555819-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.085634 Apr 11 15:24:40 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 79/239] 10.0.0.210 () {62 vars in 1232 bytes} [Tue Apr 11 15:24:40 2023] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:24:40 user devstack@n-api.service[61165]: DEBUG nova.network.neutron [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] validate_networks() for [('75a41a6a-1c7b-47b0-907e-2015d56f554e', None, None, None, None, None)] {{(pid=61165) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:24:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-836dfb5f-edb2-4704-8d58-6390a82f5a8c tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:24:40 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-836dfb5f-edb2-4704-8d58-6390a82f5a8c tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:24:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-836dfb5f-edb2-4704-8d58-6390a82f5a8c tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-836dfb5f-edb2-4704-8d58-6390a82f5a8c tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-836dfb5f-edb2-4704-8d58-6390a82f5a8c tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-836dfb5f-edb2-4704-8d58-6390a82f5a8c tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-836dfb5f-edb2-4704-8d58-6390a82f5a8c tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-836dfb5f-edb2-4704-8d58-6390a82f5a8c tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:40 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-836dfb5f-edb2-4704-8d58-6390a82f5a8c tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] HTTP exception thrown: Instance cda43d26-e2f7-4e86-b850-b914957c9b57 could not be found. Apr 11 15:24:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-836dfb5f-edb2-4704-8d58-6390a82f5a8c tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Request method failure captured: Apr 11 15:24:40 user devstack@n-api.service[61167]: request: DELETE /compute/v2.1/servers/cda43d26-e2f7-4e86-b850-b914957c9b57 HTTP/1.1 Apr 11 15:24:40 user devstack@n-api.service[61167]: Accept: application/json Apr 11 15:24:40 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 15:24:40 user devstack@n-api.service[61167]: Connection: close Apr 11 15:24:40 user devstack@n-api.service[61167]: Content-Length: 0 Apr 11 15:24:40 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 15:24:40 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 15:24:40 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 15:24:40 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 15:24:40 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNXrThb-BYv4Ul1Ov2LqRaVndgDUkX9X151vZLciv3W8IFlRIzhgqfmxx9X9hSs4-q2JSCvNz_zTvnUv5O8Ss8WHE5Ih6J6UJvfrWmMLDSifASO7skoa8ZVaYxdDHnd_o5NQNhWayZRarxaRr6i1i-4qnAH_vymrHS6okJwNUIaYFjwI Apr 11 15:24:40 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 15:24:40 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 15:24:40 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 15:24:40 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 15:24:40 user devstack@n-api.service[61167]: X-Openstack-Nova-Api-Version: 2.42 Apr 11 15:24:40 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 15:24:40 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 15:24:40 user devstack@n-api.service[61167]: X-Project-Id: e64015226c19441d87f3a6999a3a8db8 Apr 11 15:24:40 user devstack@n-api.service[61167]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-441311830 Apr 11 15:24:40 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 15:24:40 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 15:24:40 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e64015226c19441d87f3a6999a3a8db8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e64015226c19441d87f3a6999a3a8db8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e64015226c19441d87f3a6999a3a8db8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:24:40 user devstack@n-api.service[61167]: X-Tenant: tempest-TaggedBootDevicesTest_v242-441311830 Apr 11 15:24:40 user devstack@n-api.service[61167]: X-Tenant-Id: e64015226c19441d87f3a6999a3a8db8 Apr 11 15:24:40 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-441311830 Apr 11 15:24:40 user devstack@n-api.service[61167]: X-User: tempest-TaggedBootDevicesTest_v242-441311830-project-member Apr 11 15:24:40 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 15:24:40 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 15:24:40 user devstack@n-api.service[61167]: X-User-Id: 31d206ed111842fd95ce5eb5b3835a48 Apr 11 15:24:40 user devstack@n-api.service[61167]: X-User-Name: tempest-TaggedBootDevicesTest_v242-441311830-project-member Apr 11 15:24:40 user devstack@n-api.service[61167]: method: > Apr 11 15:24:40 user devstack@n-api.service[61167]: exception: Instance cda43d26-e2f7-4e86-b850-b914957c9b57 could not be found. Apr 11 15:24:40 user devstack@n-api.service[61167]: action_args: {'id': 'cda43d26-e2f7-4e86-b850-b914957c9b57'} Apr 11 15:24:40 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cda43d26-e2f7-4e86-b850-b914957c9b57 could not be found. Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cda43d26-e2f7-4e86-b850-b914957c9b57 could not be found. Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cda43d26-e2f7-4e86-b850-b914957c9b57 could not be found. Apr 11 15:24:40 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:24:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-836dfb5f-edb2-4704-8d58-6390a82f5a8c tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Returning 404 to user: Instance cda43d26-e2f7-4e86-b850-b914957c9b57 could not be found. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:24:40 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-836dfb5f-edb2-4704-8d58-6390a82f5a8c tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cda43d26-e2f7-4e86-b850-b914957c9b57" status: 404 len: 111 microversion: 2.42 time: 0.032599 Apr 11 15:24:40 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 81/240] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 15:24:40 2023] DELETE /compute/v2.1/servers/cda43d26-e2f7-4e86-b850-b914957c9b57 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 15:24:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-c02334f4-677a-4e82-846b-27b97e007426 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:24:40 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-c02334f4-677a-4e82-846b-27b97e007426 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:24:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c02334f4-677a-4e82-846b-27b97e007426 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c02334f4-677a-4e82-846b-27b97e007426 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c02334f4-677a-4e82-846b-27b97e007426 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c02334f4-677a-4e82-846b-27b97e007426 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c02334f4-677a-4e82-846b-27b97e007426 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c02334f4-677a-4e82-846b-27b97e007426 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:40 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-c02334f4-677a-4e82-846b-27b97e007426 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] HTTP exception thrown: Instance cda43d26-e2f7-4e86-b850-b914957c9b57 could not be found. Apr 11 15:24:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-c02334f4-677a-4e82-846b-27b97e007426 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Request method failure captured: Apr 11 15:24:40 user devstack@n-api.service[61166]: request: GET /compute/v2.1/servers/cda43d26-e2f7-4e86-b850-b914957c9b57 HTTP/1.1 Apr 11 15:24:40 user devstack@n-api.service[61166]: Accept: application/json Apr 11 15:24:40 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 15:24:40 user devstack@n-api.service[61166]: Connection: close Apr 11 15:24:40 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 15:24:40 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 15:24:40 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 15:24:40 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 15:24:40 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 15:24:40 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNXrThb-BYv4Ul1Ov2LqRaVndgDUkX9X151vZLciv3W8IFlRIzhgqfmxx9X9hSs4-q2JSCvNz_zTvnUv5O8Ss8WHE5Ih6J6UJvfrWmMLDSifASO7skoa8ZVaYxdDHnd_o5NQNhWayZRarxaRr6i1i-4qnAH_vymrHS6okJwNUIaYFjwI Apr 11 15:24:40 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 15:24:40 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 15:24:40 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 15:24:40 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 15:24:40 user devstack@n-api.service[61166]: X-Openstack-Nova-Api-Version: 2.42 Apr 11 15:24:40 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 15:24:40 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 15:24:40 user devstack@n-api.service[61166]: X-Project-Id: e64015226c19441d87f3a6999a3a8db8 Apr 11 15:24:40 user devstack@n-api.service[61166]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-441311830 Apr 11 15:24:40 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 15:24:40 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 15:24:40 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e64015226c19441d87f3a6999a3a8db8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e64015226c19441d87f3a6999a3a8db8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e64015226c19441d87f3a6999a3a8db8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:24:40 user devstack@n-api.service[61166]: X-Tenant: tempest-TaggedBootDevicesTest_v242-441311830 Apr 11 15:24:40 user devstack@n-api.service[61166]: X-Tenant-Id: e64015226c19441d87f3a6999a3a8db8 Apr 11 15:24:40 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-441311830 Apr 11 15:24:40 user devstack@n-api.service[61166]: X-User: tempest-TaggedBootDevicesTest_v242-441311830-project-member Apr 11 15:24:40 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 15:24:40 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 15:24:40 user devstack@n-api.service[61166]: X-User-Id: 31d206ed111842fd95ce5eb5b3835a48 Apr 11 15:24:40 user devstack@n-api.service[61166]: X-User-Name: tempest-TaggedBootDevicesTest_v242-441311830-project-member Apr 11 15:24:40 user devstack@n-api.service[61166]: method: > Apr 11 15:24:40 user devstack@n-api.service[61166]: exception: Instance cda43d26-e2f7-4e86-b850-b914957c9b57 could not be found. Apr 11 15:24:40 user devstack@n-api.service[61166]: action_args: {'id': 'cda43d26-e2f7-4e86-b850-b914957c9b57'} Apr 11 15:24:40 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cda43d26-e2f7-4e86-b850-b914957c9b57 could not be found. Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cda43d26-e2f7-4e86-b850-b914957c9b57 could not be found. Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cda43d26-e2f7-4e86-b850-b914957c9b57 could not be found. Apr 11 15:24:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:24:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-c02334f4-677a-4e82-846b-27b97e007426 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Returning 404 to user: Instance cda43d26-e2f7-4e86-b850-b914957c9b57 could not be found. {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:24:40 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-c02334f4-677a-4e82-846b-27b97e007426 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cda43d26-e2f7-4e86-b850-b914957c9b57" status: 404 len: 111 microversion: 2.42 time: 0.030833 Apr 11 15:24:40 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 80/241] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:24:40 2023] GET /compute/v2.1/servers/cda43d26-e2f7-4e86-b850-b914957c9b57 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 15:24:41 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Flavor limits 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:24:41 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Image limits 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:24:41 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Flavor pref 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:24:41 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Image pref 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:24:41 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:24:41 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:41 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:41 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:41 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:41 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:41 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:41 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Getting quotas for project 63ed867a40534b70bf75dc0cc28fdfec. Resources: {'instances', 'cores', 'ram'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:24:41 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Getting quotas for user 49e1716b2bb2438b93d46dc8052c788b and project 63ed867a40534b70bf75dc0cc28fdfec. Resources: {'instances', 'cores', 'ram'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:24:41 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Going to run 1 instances... {{(pid=61165) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:24:41 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3132ad02-1f63-469b-b802-d814466b9ad7',volume_size=None,volume_type=None)] {{(pid=61165) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:24:41 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.390326 Apr 11 15:24:41 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 81/242] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 15:24:40 2023] POST /compute/v2.1/servers => generated 404 bytes in 1392 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 15:24:41 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-07c5a163-4419-4b3d-8e87-388f97f7d53f tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:24:41 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-07c5a163-4419-4b3d-8e87-388f97f7d53f tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:24:41 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-07c5a163-4419-4b3d-8e87-388f97f7d53f tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e1716b2bb2438b93d46dc8052c788b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ed867a40534b70bf75dc0cc28fdfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:24:41 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-07c5a163-4419-4b3d-8e87-388f97f7d53f tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39e3dfb1-bc09-474d-b8cb-f01b11923eae" status: 200 len: 1084 microversion: 2.1 time: 0.067569 Apr 11 15:24:41 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 82/243] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:24:41 2023] GET /compute/v2.1/servers/39e3dfb1-bc09-474d-b8cb-f01b11923eae => generated 1084 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:24:43 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-918ba5fb-9a76-44be-874a-44ff81321d2a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:24:43 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-918ba5fb-9a76-44be-874a-44ff81321d2a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:24:43 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-918ba5fb-9a76-44be-874a-44ff81321d2a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:43 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-918ba5fb-9a76-44be-874a-44ff81321d2a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:43 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-918ba5fb-9a76-44be-874a-44ff81321d2a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:43 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-918ba5fb-9a76-44be-874a-44ff81321d2a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:43 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-918ba5fb-9a76-44be-874a-44ff81321d2a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:43 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-918ba5fb-9a76-44be-874a-44ff81321d2a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:43 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-918ba5fb-9a76-44be-874a-44ff81321d2a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:24:43 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-918ba5fb-9a76-44be-874a-44ff81321d2a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:24:43 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-918ba5fb-9a76-44be-874a-44ff81321d2a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:24:43 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-918ba5fb-9a76-44be-874a-44ff81321d2a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0d90fd2-6a95-43c4-8756-e82071d99154" status: 200 len: 1768 microversion: 2.87 time: 0.324217 Apr 11 15:24:43 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 81/244] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:24:43 2023] GET /compute/v2.1/servers/b0d90fd2-6a95-43c4-8756-e82071d99154 => generated 1768 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:24:45 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-5b3b1c05-d6f4-4307-b811-8daa60279312 req-da484cfd-dfd9-4de6-bd01-7a3494d82398 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39e3dfb1-bc09-474d-b8cb-f01b11923eae", "tag": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:24:45 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-5b3b1c05-d6f4-4307-b811-8daa60279312 req-da484cfd-dfd9-4de6-bd01-7a3494d82398 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:45 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-5b3b1c05-d6f4-4307-b811-8daa60279312 req-da484cfd-dfd9-4de6-bd01-7a3494d82398 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:45 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-5b3b1c05-d6f4-4307-b811-8daa60279312 req-da484cfd-dfd9-4de6-bd01-7a3494d82398 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:45 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-5b3b1c05-d6f4-4307-b811-8daa60279312 req-da484cfd-dfd9-4de6-bd01-7a3494d82398 service nova] Creating event network-changed:21d628ba-6bae-4d98-94df-bb6fbb4f1c24 for instance 39e3dfb1-bc09-474d-b8cb-f01b11923eae on user Apr 11 15:24:45 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-5b3b1c05-d6f4-4307-b811-8daa60279312 req-da484cfd-dfd9-4de6-bd01-7a3494d82398 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032755 Apr 11 15:24:45 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 82/245] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:24:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:24:47 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-1d3da8ed-2972-4d96-a278-8c7ac1c023fa tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:24:47 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-1d3da8ed-2972-4d96-a278-8c7ac1c023fa tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:24:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1d3da8ed-2972-4d96-a278-8c7ac1c023fa tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1d3da8ed-2972-4d96-a278-8c7ac1c023fa tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1d3da8ed-2972-4d96-a278-8c7ac1c023fa tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1d3da8ed-2972-4d96-a278-8c7ac1c023fa tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1d3da8ed-2972-4d96-a278-8c7ac1c023fa tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1d3da8ed-2972-4d96-a278-8c7ac1c023fa tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:47 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-1d3da8ed-2972-4d96-a278-8c7ac1c023fa tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc44d2042554ca0b0bde4b2de5b566a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a341ccfc0b4f08bb2e97083143dd40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:24:47 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-1d3da8ed-2972-4d96-a278-8c7ac1c023fa tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] 10.0.0.210 "GET /compute/v2.1/servers/068f10b4-086e-4af7-a53e-f6ece73d01e4" status: 200 len: 1485 microversion: 2.1 time: 0.202802 Apr 11 15:24:47 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 83/246] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:24:47 2023] GET /compute/v2.1/servers/068f10b4-086e-4af7-a53e-f6ece73d01e4 => generated 1485 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:24:49 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-ba13f57b-8547-473d-9764-9c52b1bacf99 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:24:49 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-ba13f57b-8547-473d-9764-9c52b1bacf99 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:24:49 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:24:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ba13f57b-8547-473d-9764-9c52b1bacf99 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ba13f57b-8547-473d-9764-9c52b1bacf99 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ba13f57b-8547-473d-9764-9c52b1bacf99 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ba13f57b-8547-473d-9764-9c52b1bacf99 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ba13f57b-8547-473d-9764-9c52b1bacf99 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ba13f57b-8547-473d-9764-9c52b1bacf99 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:49 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-ba13f57b-8547-473d-9764-9c52b1bacf99 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:24:49 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-ba13f57b-8547-473d-9764-9c52b1bacf99 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35" status: 200 len: 1659 microversion: 2.1 time: 0.298912 Apr 11 15:24:49 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 82/247] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:24:49 2023] GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35 => generated 1659 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:24:49 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4"}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:24:49 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:24:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:49 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286233 Apr 11 15:24:49 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 83/248] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 15:24:49 2023] POST /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:24:50 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-12dbe67b-cb41-4e0d-8eff-2519fb2ef962 req-50d40eca-513c-448b-8368-52ac72b7d0fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e3dfb1-bc09-474d-b8cb-f01b11923eae", "name": "network-vif-plugged", "status": "completed", "tag": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:24:50 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-12dbe67b-cb41-4e0d-8eff-2519fb2ef962 req-50d40eca-513c-448b-8368-52ac72b7d0fc service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:50 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-12dbe67b-cb41-4e0d-8eff-2519fb2ef962 req-50d40eca-513c-448b-8368-52ac72b7d0fc service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:50 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-12dbe67b-cb41-4e0d-8eff-2519fb2ef962 req-50d40eca-513c-448b-8368-52ac72b7d0fc service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:50 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-12dbe67b-cb41-4e0d-8eff-2519fb2ef962 req-50d40eca-513c-448b-8368-52ac72b7d0fc service nova] Creating event network-vif-plugged:21d628ba-6bae-4d98-94df-bb6fbb4f1c24 for instance 39e3dfb1-bc09-474d-b8cb-f01b11923eae on user Apr 11 15:24:50 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-12dbe67b-cb41-4e0d-8eff-2519fb2ef962 req-50d40eca-513c-448b-8368-52ac72b7d0fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051109 Apr 11 15:24:50 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 84/249] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:24:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:24:52 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-c0d44407-0d0b-4c76-9384-c177d8917c79 req-fb26a3fe-318b-4911-9484-85ce65325f46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e3dfb1-bc09-474d-b8cb-f01b11923eae", "name": "network-vif-plugged", "status": "completed", "tag": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:24:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-c0d44407-0d0b-4c76-9384-c177d8917c79 req-fb26a3fe-318b-4911-9484-85ce65325f46 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-c0d44407-0d0b-4c76-9384-c177d8917c79 req-fb26a3fe-318b-4911-9484-85ce65325f46 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-c0d44407-0d0b-4c76-9384-c177d8917c79 req-fb26a3fe-318b-4911-9484-85ce65325f46 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:52 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-c0d44407-0d0b-4c76-9384-c177d8917c79 req-fb26a3fe-318b-4911-9484-85ce65325f46 service nova] Creating event network-vif-plugged:21d628ba-6bae-4d98-94df-bb6fbb4f1c24 for instance 39e3dfb1-bc09-474d-b8cb-f01b11923eae on user Apr 11 15:24:52 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-c0d44407-0d0b-4c76-9384-c177d8917c79 req-fb26a3fe-318b-4911-9484-85ce65325f46 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041734 Apr 11 15:24:52 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 83/250] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:24:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:24:53 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:24:53 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:24:53 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-8da27733-96fa-491e-8591-b70c13b61cc5 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:24:53 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-8da27733-96fa-491e-8591-b70c13b61cc5 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:24:53 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-8da27733-96fa-491e-8591-b70c13b61cc5 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:53 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-8da27733-96fa-491e-8591-b70c13b61cc5 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:53 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-8da27733-96fa-491e-8591-b70c13b61cc5 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:53 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-8da27733-96fa-491e-8591-b70c13b61cc5 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:53 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-8da27733-96fa-491e-8591-b70c13b61cc5 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:53 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-8da27733-96fa-491e-8591-b70c13b61cc5 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:53 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-8da27733-96fa-491e-8591-b70c13b61cc5 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:24:53 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-8da27733-96fa-491e-8591-b70c13b61cc5 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:24:53 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-8da27733-96fa-491e-8591-b70c13b61cc5 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:24:53 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-8da27733-96fa-491e-8591-b70c13b61cc5 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" status: 200 len: 1587 microversion: 2.20 time: 0.168309 Apr 11 15:24:53 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 84/251] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:24:53 2023] GET /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d => generated 1587 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:24:57 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:24:57 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-ad616582-da41-4210-bb3a-7efeaa315c19 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:24:57 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-ad616582-da41-4210-bb3a-7efeaa315c19 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:24:57 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ad616582-da41-4210-bb3a-7efeaa315c19 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:57 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ad616582-da41-4210-bb3a-7efeaa315c19 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:57 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ad616582-da41-4210-bb3a-7efeaa315c19 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:57 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ad616582-da41-4210-bb3a-7efeaa315c19 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:57 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ad616582-da41-4210-bb3a-7efeaa315c19 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:57 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ad616582-da41-4210-bb3a-7efeaa315c19 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:57 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-ad616582-da41-4210-bb3a-7efeaa315c19 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:24:57 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-ad616582-da41-4210-bb3a-7efeaa315c19 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35" status: 200 len: 1705 microversion: 2.1 time: 0.205247 Apr 11 15:24:57 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 85/252] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:24:57 2023] GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35 => generated 1705 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:24:57 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-252985182", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:24:57 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:24:57 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:57 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:57 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:57 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:57 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:57 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:57 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Getting quotas for project bb7660e8f76b471487136806ee9eec62. Resources: dict_keys(['metadata_items']) {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:24:57 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Getting quotas for user 10720df0ac4f4e62a0a5c9883d600add and project bb7660e8f76b471487136806ee9eec62. Resources: dict_keys(['metadata_items']) {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:24:57 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Flavor limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:24:57 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Image limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:24:57 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Flavor pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:24:57 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Image pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:24:57 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:24:58 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:24:58 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:58 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:58 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:58 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:58 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:58 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:58 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35/action" status: 202 len: 1159 microversion: 2.1 time: 0.425872 Apr 11 15:24:58 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 84/253] 10.0.0.210 () {64 vars in 1356 bytes} [Tue Apr 11 15:24:57 2023] POST /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35/action => generated 1159 bytes in 428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 15:24:58 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-bd3bd432-53c3-4fe7-9549-e5af1d293be9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:24:58 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-bd3bd432-53c3-4fe7-9549-e5af1d293be9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:24:58 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-bd3bd432-53c3-4fe7-9549-e5af1d293be9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:58 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-bd3bd432-53c3-4fe7-9549-e5af1d293be9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:58 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-bd3bd432-53c3-4fe7-9549-e5af1d293be9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:58 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-bd3bd432-53c3-4fe7-9549-e5af1d293be9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:58 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-bd3bd432-53c3-4fe7-9549-e5af1d293be9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:58 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-bd3bd432-53c3-4fe7-9549-e5af1d293be9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:58 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-bd3bd432-53c3-4fe7-9549-e5af1d293be9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:24:58 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-bd3bd432-53c3-4fe7-9549-e5af1d293be9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35" status: 200 len: 1732 microversion: 2.1 time: 0.184889 Apr 11 15:24:58 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 85/254] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:24:58 2023] GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35 => generated 1732 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:24:59 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-f2f3c490-f30e-4b0f-9506-527cbcde2900 req-18f312dd-1dc1-426b-937f-b35140ea2d90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a805345-374c-4326-9e8f-39bfc7947a35", "name": "network-vif-unplugged", "status": "completed", "tag": "d8c64197-b034-4f38-821d-ba030f1fca6b"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:24:59 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-f2f3c490-f30e-4b0f-9506-527cbcde2900 req-18f312dd-1dc1-426b-937f-b35140ea2d90 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:24:59 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-f2f3c490-f30e-4b0f-9506-527cbcde2900 req-18f312dd-1dc1-426b-937f-b35140ea2d90 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:24:59 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-f2f3c490-f30e-4b0f-9506-527cbcde2900 req-18f312dd-1dc1-426b-937f-b35140ea2d90 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:24:59 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-f2f3c490-f30e-4b0f-9506-527cbcde2900 req-18f312dd-1dc1-426b-937f-b35140ea2d90 service nova] Creating event network-vif-unplugged:d8c64197-b034-4f38-821d-ba030f1fca6b for instance 6a805345-374c-4326-9e8f-39bfc7947a35 on user Apr 11 15:24:59 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-f2f3c490-f30e-4b0f-9506-527cbcde2900 req-18f312dd-1dc1-426b-937f-b35140ea2d90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029001 Apr 11 15:24:59 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 86/255] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:24:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:25:00 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-704141251", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "networks": [{"uuid": "f9b1d398-27cb-42de-9d95-0e031b1bd6ec"}]}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:25:00 user devstack@n-api.service[61166]: DEBUG nova.network.neutron [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] validate_networks() for [('f9b1d398-27cb-42de-9d95-0e031b1bd6ec', None, None, None, None, None)] {{(pid=61166) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:25:01 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Flavor limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:25:01 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Image limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:25:01 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Flavor pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:25:01 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Image pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:25:01 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:25:01 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:01 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:01 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:01 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:01 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:01 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:01 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Getting quotas for project 561130d089c8415297697bcedc93aefc. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:25:01 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Getting quotas for user b2538af5c739404aa433b766976e5b2d and project 561130d089c8415297697bcedc93aefc. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:25:01 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Going to run 1 instances... {{(pid=61166) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:25:01 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52fe638c-5ada-47d5-b376-233bfa808a37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:25:01 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.672110 Apr 11 15:25:01 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 85/256] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 15:25:00 2023] POST /compute/v2.1/servers => generated 378 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 15:25:01 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-f4003812-9448-4307-a48e-db859ec758e6 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:25:01 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-f4003812-9448-4307-a48e-db859ec758e6 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:25:01 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-f4003812-9448-4307-a48e-db859ec758e6 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2538af5c739404aa433b766976e5b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561130d089c8415297697bcedc93aefc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:25:01 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-f4003812-9448-4307-a48e-db859ec758e6 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4555892-7abb-4a3c-a4ae-a27ad4902708" status: 200 len: 1210 microversion: 2.1 time: 0.067446 Apr 11 15:25:01 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 86/257] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:25:01 2023] GET /compute/v2.1/servers/e4555892-7abb-4a3c-a4ae-a27ad4902708 => generated 1210 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:25:01 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-0fa91682-e3d4-49f5-a004-31a889e8e44b req-4277ed3a-43f8-4e91-891f-5541267a8c72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a805345-374c-4326-9e8f-39bfc7947a35", "name": "network-vif-plugged", "status": "completed", "tag": "d8c64197-b034-4f38-821d-ba030f1fca6b"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:25:01 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-0fa91682-e3d4-49f5-a004-31a889e8e44b req-4277ed3a-43f8-4e91-891f-5541267a8c72 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:01 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-0fa91682-e3d4-49f5-a004-31a889e8e44b req-4277ed3a-43f8-4e91-891f-5541267a8c72 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:01 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-0fa91682-e3d4-49f5-a004-31a889e8e44b req-4277ed3a-43f8-4e91-891f-5541267a8c72 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:01 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-0fa91682-e3d4-49f5-a004-31a889e8e44b req-4277ed3a-43f8-4e91-891f-5541267a8c72 service nova] Creating event network-vif-plugged:d8c64197-b034-4f38-821d-ba030f1fca6b for instance 6a805345-374c-4326-9e8f-39bfc7947a35 on user Apr 11 15:25:01 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-0fa91682-e3d4-49f5-a004-31a889e8e44b req-4277ed3a-43f8-4e91-891f-5541267a8c72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028080 Apr 11 15:25:01 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 87/258] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:25:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:25:04 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-5d4b17ef-4c91-46a5-988b-82fe21dd8ac5 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:25:04 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-5d4b17ef-4c91-46a5-988b-82fe21dd8ac5 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:25:04 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-5d4b17ef-4c91-46a5-988b-82fe21dd8ac5 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:04 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-5d4b17ef-4c91-46a5-988b-82fe21dd8ac5 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:04 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-5d4b17ef-4c91-46a5-988b-82fe21dd8ac5 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:04 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-5d4b17ef-4c91-46a5-988b-82fe21dd8ac5 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:04 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-5d4b17ef-4c91-46a5-988b-82fe21dd8ac5 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:04 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-5d4b17ef-4c91-46a5-988b-82fe21dd8ac5 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:04 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-0e6d7747-9945-43ba-8082-59101f298d69 req-360caa9a-ad01-46fe-bd1f-9b8641924423 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4555892-7abb-4a3c-a4ae-a27ad4902708", "tag": "a002e821-ea54-4d5c-b25c-8c517fab4e92"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:25:04 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-0e6d7747-9945-43ba-8082-59101f298d69 req-360caa9a-ad01-46fe-bd1f-9b8641924423 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:04 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-0e6d7747-9945-43ba-8082-59101f298d69 req-360caa9a-ad01-46fe-bd1f-9b8641924423 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:04 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-0e6d7747-9945-43ba-8082-59101f298d69 req-360caa9a-ad01-46fe-bd1f-9b8641924423 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:04 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-0e6d7747-9945-43ba-8082-59101f298d69 req-360caa9a-ad01-46fe-bd1f-9b8641924423 service nova] Creating event network-changed:a002e821-ea54-4d5c-b25c-8c517fab4e92 for instance e4555892-7abb-4a3c-a4ae-a27ad4902708 on user Apr 11 15:25:04 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-0e6d7747-9945-43ba-8082-59101f298d69 req-360caa9a-ad01-46fe-bd1f-9b8641924423 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087730 Apr 11 15:25:04 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 87/259] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:25:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:25:04 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-5d4b17ef-4c91-46a5-988b-82fe21dd8ac5 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2717e456dcc941899c48c3c973083bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da140971126a4d298ff718275e7a22ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:25:04 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-5d4b17ef-4c91-46a5-988b-82fe21dd8ac5 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b59399aa-f550-41c7-9818-6cb1f271fb52" status: 200 len: 1496 microversion: 2.1 time: 0.295124 Apr 11 15:25:04 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 86/260] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:25:04 2023] GET /compute/v2.1/servers/b59399aa-f550-41c7-9818-6cb1f271fb52 => generated 1496 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 15:25:06 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-42e1a2ff-fb78-415f-bed3-1b4959100f80 req-49377000-ef0f-4d5e-ae0c-622995bc9265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4555892-7abb-4a3c-a4ae-a27ad4902708", "name": "network-vif-plugged", "status": "completed", "tag": "a002e821-ea54-4d5c-b25c-8c517fab4e92"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:25:06 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=21 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:25:06 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-42e1a2ff-fb78-415f-bed3-1b4959100f80 req-49377000-ef0f-4d5e-ae0c-622995bc9265 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:06 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-42e1a2ff-fb78-415f-bed3-1b4959100f80 req-49377000-ef0f-4d5e-ae0c-622995bc9265 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:06 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-42e1a2ff-fb78-415f-bed3-1b4959100f80 req-49377000-ef0f-4d5e-ae0c-622995bc9265 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:06 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=29 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:25:06 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-42e1a2ff-fb78-415f-bed3-1b4959100f80 req-49377000-ef0f-4d5e-ae0c-622995bc9265 service nova] Creating event network-vif-plugged:a002e821-ea54-4d5c-b25c-8c517fab4e92 for instance e4555892-7abb-4a3c-a4ae-a27ad4902708 on user Apr 11 15:25:06 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-42e1a2ff-fb78-415f-bed3-1b4959100f80 req-49377000-ef0f-4d5e-ae0c-622995bc9265 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064682 Apr 11 15:25:06 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 88/261] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:25:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:25:08 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-59af60b4-e397-4a06-b9f3-209b1be1ecf2 req-ec1d359b-3845-4abf-98c3-853f7bcc3ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4555892-7abb-4a3c-a4ae-a27ad4902708", "name": "network-vif-plugged", "status": "completed", "tag": "a002e821-ea54-4d5c-b25c-8c517fab4e92"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:25:08 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:25:08 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-59af60b4-e397-4a06-b9f3-209b1be1ecf2 req-ec1d359b-3845-4abf-98c3-853f7bcc3ed0 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:08 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-59af60b4-e397-4a06-b9f3-209b1be1ecf2 req-ec1d359b-3845-4abf-98c3-853f7bcc3ed0 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:08 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-59af60b4-e397-4a06-b9f3-209b1be1ecf2 req-ec1d359b-3845-4abf-98c3-853f7bcc3ed0 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:08 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:25:08 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-59af60b4-e397-4a06-b9f3-209b1be1ecf2 req-ec1d359b-3845-4abf-98c3-853f7bcc3ed0 service nova] Creating event network-vif-plugged:a002e821-ea54-4d5c-b25c-8c517fab4e92 for instance e4555892-7abb-4a3c-a4ae-a27ad4902708 on user Apr 11 15:25:08 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-59af60b4-e397-4a06-b9f3-209b1be1ecf2 req-ec1d359b-3845-4abf-98c3-853f7bcc3ed0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039095 Apr 11 15:25:08 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 88/262] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:25:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:25:10 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-91a52fc6-a8bc-401a-9090-977133b366df req-6c08000f-2271-44ee-a594-4c3ef6943244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a805345-374c-4326-9e8f-39bfc7947a35", "name": "network-vif-plugged", "status": "completed", "tag": "d8c64197-b034-4f38-821d-ba030f1fca6b"}, {"server_uuid": "6a805345-374c-4326-9e8f-39bfc7947a35", "name": "network-vif-plugged", "status": "completed", "tag": "d8c64197-b034-4f38-821d-ba030f1fca6b"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:25:10 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:25:10 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-91a52fc6-a8bc-401a-9090-977133b366df req-6c08000f-2271-44ee-a594-4c3ef6943244 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:10 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-91a52fc6-a8bc-401a-9090-977133b366df req-6c08000f-2271-44ee-a594-4c3ef6943244 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:10 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-91a52fc6-a8bc-401a-9090-977133b366df req-6c08000f-2271-44ee-a594-4c3ef6943244 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:10 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=6,nova_cell1:INSERT=3,nova_cell1:DELETE=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:25:10 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-91a52fc6-a8bc-401a-9090-977133b366df req-6c08000f-2271-44ee-a594-4c3ef6943244 service nova] Creating event network-vif-plugged:d8c64197-b034-4f38-821d-ba030f1fca6b for instance 6a805345-374c-4326-9e8f-39bfc7947a35 on user Apr 11 15:25:10 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-91a52fc6-a8bc-401a-9090-977133b366df req-6c08000f-2271-44ee-a594-4c3ef6943244 service nova] Creating event network-vif-plugged:d8c64197-b034-4f38-821d-ba030f1fca6b for instance 6a805345-374c-4326-9e8f-39bfc7947a35 on user Apr 11 15:25:10 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-91a52fc6-a8bc-401a-9090-977133b366df req-6c08000f-2271-44ee-a594-4c3ef6943244 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044537 Apr 11 15:25:10 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 87/263] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:25:10 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:25:25 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:25:25 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:25:25 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-b596213e-64e8-4615-834f-8dbd5dced48f tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:25:25 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-b596213e-64e8-4615-834f-8dbd5dced48f tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:25:25 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b596213e-64e8-4615-834f-8dbd5dced48f tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:25 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b596213e-64e8-4615-834f-8dbd5dced48f tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:25 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b596213e-64e8-4615-834f-8dbd5dced48f tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:25 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b596213e-64e8-4615-834f-8dbd5dced48f tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:25 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b596213e-64e8-4615-834f-8dbd5dced48f tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:25 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b596213e-64e8-4615-834f-8dbd5dced48f tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:25 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-b596213e-64e8-4615-834f-8dbd5dced48f tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] HTTP exception thrown: Instance 8d84862f-b710-48b1-9275-93fc799cf1f9 could not be found. Apr 11 15:25:25 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-b596213e-64e8-4615-834f-8dbd5dced48f tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Request method failure captured: Apr 11 15:25:25 user devstack@n-api.service[61167]: request: GET /compute/v2.1/servers/8d84862f-b710-48b1-9275-93fc799cf1f9 HTTP/1.1 Apr 11 15:25:25 user devstack@n-api.service[61167]: Accept: application/json Apr 11 15:25:25 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 15:25:25 user devstack@n-api.service[61167]: Connection: close Apr 11 15:25:25 user devstack@n-api.service[61167]: Content-Length: 0 Apr 11 15:25:25 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 15:25:25 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 15:25:25 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 15:25:25 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 15:25:25 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNXrT2XWQkIn1KteKOsfOFhswjQUbWcwNuUIIXhVwGTSiESFA71O4b-Bwyt7V5Es-R8J7S-cM7335IlP6ZUAYgD4mH_WwbyK-RhJFc9OzIT2iUSmIt5rsEo37S3U9Ig0_TLrX5vaONQhqdkxCi9cmCZkwQZmmhDQs9N70wvBAdSC3oc8 Apr 11 15:25:25 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 15:25:25 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 15:25:25 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 15:25:25 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 15:25:25 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 15:25:25 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 15:25:25 user devstack@n-api.service[61167]: X-Project-Id: f7c88bf2782342c8af04195140d6cd0e Apr 11 15:25:25 user devstack@n-api.service[61167]: X-Project-Name: tempest-TestVolumeSwap-1716929011 Apr 11 15:25:25 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 15:25:25 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 15:25:25 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f7c88bf2782342c8af04195140d6cd0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f7c88bf2782342c8af04195140d6cd0e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f7c88bf2782342c8af04195140d6cd0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:25:25 user devstack@n-api.service[61167]: X-Tenant: tempest-TestVolumeSwap-1716929011 Apr 11 15:25:25 user devstack@n-api.service[61167]: X-Tenant-Id: f7c88bf2782342c8af04195140d6cd0e Apr 11 15:25:25 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-TestVolumeSwap-1716929011 Apr 11 15:25:25 user devstack@n-api.service[61167]: X-User: tempest-TestVolumeSwap-1716929011-project-member Apr 11 15:25:25 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 15:25:25 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 15:25:25 user devstack@n-api.service[61167]: X-User-Id: a2ec75db561b4fec903a1a391c3d03e3 Apr 11 15:25:25 user devstack@n-api.service[61167]: X-User-Name: tempest-TestVolumeSwap-1716929011-project-member Apr 11 15:25:25 user devstack@n-api.service[61167]: method: > Apr 11 15:25:25 user devstack@n-api.service[61167]: exception: Instance 8d84862f-b710-48b1-9275-93fc799cf1f9 could not be found. Apr 11 15:25:25 user devstack@n-api.service[61167]: action_args: {'id': '8d84862f-b710-48b1-9275-93fc799cf1f9'} Apr 11 15:25:25 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d84862f-b710-48b1-9275-93fc799cf1f9 could not be found. Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d84862f-b710-48b1-9275-93fc799cf1f9 could not be found. Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d84862f-b710-48b1-9275-93fc799cf1f9 could not be found. Apr 11 15:25:25 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:25:25 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-b596213e-64e8-4615-834f-8dbd5dced48f tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Returning 404 to user: Instance 8d84862f-b710-48b1-9275-93fc799cf1f9 could not be found. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:25:25 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-b596213e-64e8-4615-834f-8dbd5dced48f tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d84862f-b710-48b1-9275-93fc799cf1f9" status: 404 len: 111 microversion: 2.1 time: 0.036457 Apr 11 15:25:25 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 89/264] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:25:25 2023] GET /compute/v2.1/servers/8d84862f-b710-48b1-9275-93fc799cf1f9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:25:25 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:25:25 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:25:25 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-d525cb08-af79-4014-99e2-3fef5618cdb7 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Calling method '.version_select at 0x7f4c2ef2c790>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:25:25 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-d525cb08-af79-4014-99e2-3fef5618cdb7 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-445229818" status: 202 len: 0 microversion: 2.1 time: 0.030149 Apr 11 15:25:25 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 89/265] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 15:25:25 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-445229818 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:25:32 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:25:32 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:25:32 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:25:32 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-10024743-e2ea-40fc-b747-a9a980ffd9ec tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:25:32 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-10024743-e2ea-40fc-b747-a9a980ffd9ec tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:25:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-10024743-e2ea-40fc-b747-a9a980ffd9ec tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-10024743-e2ea-40fc-b747-a9a980ffd9ec tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-10024743-e2ea-40fc-b747-a9a980ffd9ec tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-10024743-e2ea-40fc-b747-a9a980ffd9ec tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-10024743-e2ea-40fc-b747-a9a980ffd9ec tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-10024743-e2ea-40fc-b747-a9a980ffd9ec tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:32 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-10024743-e2ea-40fc-b747-a9a980ffd9ec tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e1716b2bb2438b93d46dc8052c788b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ed867a40534b70bf75dc0cc28fdfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:25:32 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-10024743-e2ea-40fc-b747-a9a980ffd9ec tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39e3dfb1-bc09-474d-b8cb-f01b11923eae" status: 200 len: 1435 microversion: 2.1 time: 0.160217 Apr 11 15:25:32 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 88/266] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:25:32 2023] GET /compute/v2.1/servers/39e3dfb1-bc09-474d-b8cb-f01b11923eae => generated 1435 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:25:43 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "eded9003-50e7-486b-bac5-dfc18b519c48"}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:25:43 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:25:43 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:25:43 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:25:43 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:43 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:43 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:43 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:43 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:43 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:43 user devstack@n-api.service[61167]: DEBUG nova.objects.instance [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lazy-loading 'flavor' on Instance uuid b0d90fd2-6a95-43c4-8756-e82071d99154 {{(pid=61167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 15:25:44 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b0d90fd2-6a95-43c4-8756-e82071d99154/action" status: 200 len: 29 microversion: 2.87 time: 0.853901 Apr 11 15:25:44 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 90/267] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 15:25:43 2023] POST /compute/v2.1/servers/b0d90fd2-6a95-43c4-8756-e82071d99154/action => generated 29 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:25:44 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:25:44 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:25:44 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-92cfb414-7136-4ca8-96a6-114d77717c8a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:25:44 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-92cfb414-7136-4ca8-96a6-114d77717c8a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:25:44 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-92cfb414-7136-4ca8-96a6-114d77717c8a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:44 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-92cfb414-7136-4ca8-96a6-114d77717c8a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:44 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-92cfb414-7136-4ca8-96a6-114d77717c8a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:44 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-92cfb414-7136-4ca8-96a6-114d77717c8a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:44 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-92cfb414-7136-4ca8-96a6-114d77717c8a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:44 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-92cfb414-7136-4ca8-96a6-114d77717c8a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:44 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-92cfb414-7136-4ca8-96a6-114d77717c8a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:25:44 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-92cfb414-7136-4ca8-96a6-114d77717c8a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:25:44 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-92cfb414-7136-4ca8-96a6-114d77717c8a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:25:45 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-92cfb414-7136-4ca8-96a6-114d77717c8a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0d90fd2-6a95-43c4-8756-e82071d99154" status: 200 len: 1774 microversion: 2.87 time: 0.385374 Apr 11 15:25:45 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 90/268] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:25:44 2023] GET /compute/v2.1/servers/b0d90fd2-6a95-43c4-8756-e82071d99154 => generated 1774 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:25:45 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=3 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:25:45 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:25:45 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-09284262-d181-42be-af35-78b725901628 req-b8575077-9697-4bc2-9728-91a0f5f2f187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d90fd2-6a95-43c4-8756-e82071d99154", "name": "network-vif-unplugged", "status": "completed", "tag": "4718fa68-0eb9-4592-8c43-981438e3d0b8"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:25:45 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-09284262-d181-42be-af35-78b725901628 req-b8575077-9697-4bc2-9728-91a0f5f2f187 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:45 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-09284262-d181-42be-af35-78b725901628 req-b8575077-9697-4bc2-9728-91a0f5f2f187 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:45 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-09284262-d181-42be-af35-78b725901628 req-b8575077-9697-4bc2-9728-91a0f5f2f187 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:45 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-09284262-d181-42be-af35-78b725901628 req-b8575077-9697-4bc2-9728-91a0f5f2f187 service nova] Creating event network-vif-unplugged:4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance b0d90fd2-6a95-43c4-8756-e82071d99154 on user Apr 11 15:25:45 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-09284262-d181-42be-af35-78b725901628 req-b8575077-9697-4bc2-9728-91a0f5f2f187 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034947 Apr 11 15:25:45 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 89/269] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:25:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:25:47 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-4b4f0e8d-455a-472e-a369-921585634854 req-7b716320-6449-4360-b5b6-c43f52f9f370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d90fd2-6a95-43c4-8756-e82071d99154", "name": "network-vif-plugged", "status": "completed", "tag": "4718fa68-0eb9-4592-8c43-981438e3d0b8"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:25:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-4b4f0e8d-455a-472e-a369-921585634854 req-7b716320-6449-4360-b5b6-c43f52f9f370 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-4b4f0e8d-455a-472e-a369-921585634854 req-7b716320-6449-4360-b5b6-c43f52f9f370 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-4b4f0e8d-455a-472e-a369-921585634854 req-7b716320-6449-4360-b5b6-c43f52f9f370 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:47 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-4b4f0e8d-455a-472e-a369-921585634854 req-7b716320-6449-4360-b5b6-c43f52f9f370 service nova] Creating event network-vif-plugged:4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance b0d90fd2-6a95-43c4-8756-e82071d99154 on user Apr 11 15:25:47 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-4b4f0e8d-455a-472e-a369-921585634854 req-7b716320-6449-4360-b5b6-c43f52f9f370 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030872 Apr 11 15:25:47 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 91/270] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:25:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:25:47 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:25:47 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:25:47 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:47 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:47 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:47 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:47 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:47 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:48 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Going to try to terminate instance {{(pid=61165) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:25:48 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/068f10b4-086e-4af7-a53e-f6ece73d01e4" status: 204 len: 0 microversion: 2.1 time: 0.115823 Apr 11 15:25:48 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 91/271] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:25:47 2023] DELETE /compute/v2.1/servers/068f10b4-086e-4af7-a53e-f6ece73d01e4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:25:48 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-4c0c177d-4f66-4554-8fdc-74c253f09873 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:25:48 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-4c0c177d-4f66-4554-8fdc-74c253f09873 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:25:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4c0c177d-4f66-4554-8fdc-74c253f09873 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4c0c177d-4f66-4554-8fdc-74c253f09873 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4c0c177d-4f66-4554-8fdc-74c253f09873 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4c0c177d-4f66-4554-8fdc-74c253f09873 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4c0c177d-4f66-4554-8fdc-74c253f09873 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4c0c177d-4f66-4554-8fdc-74c253f09873 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:48 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-4c0c177d-4f66-4554-8fdc-74c253f09873 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc44d2042554ca0b0bde4b2de5b566a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a341ccfc0b4f08bb2e97083143dd40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:25:48 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-4c0c177d-4f66-4554-8fdc-74c253f09873 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] 10.0.0.210 "GET /compute/v2.1/servers/068f10b4-086e-4af7-a53e-f6ece73d01e4" status: 200 len: 1491 microversion: 2.1 time: 0.221618 Apr 11 15:25:48 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 90/272] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:25:48 2023] GET /compute/v2.1/servers/068f10b4-086e-4af7-a53e-f6ece73d01e4 => generated 1491 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:25:48 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-cbc03509-b428-4df1-89c4-3c3754fe3daa tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:25:48 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-cbc03509-b428-4df1-89c4-3c3754fe3daa tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:25:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-cbc03509-b428-4df1-89c4-3c3754fe3daa tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-cbc03509-b428-4df1-89c4-3c3754fe3daa tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-cbc03509-b428-4df1-89c4-3c3754fe3daa tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-cbc03509-b428-4df1-89c4-3c3754fe3daa tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-cbc03509-b428-4df1-89c4-3c3754fe3daa tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-cbc03509-b428-4df1-89c4-3c3754fe3daa tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:48 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-cbc03509-b428-4df1-89c4-3c3754fe3daa tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:25:48 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-cbc03509-b428-4df1-89c4-3c3754fe3daa tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35" status: 200 len: 1723 microversion: 2.1 time: 0.164575 Apr 11 15:25:48 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 92/273] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:25:48 2023] GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:25:49 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-6bd64e69-1f86-498c-93cd-488c1f2d7183 req-8404426b-efa7-4a3f-a89e-e7b3816d775d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "068f10b4-086e-4af7-a53e-f6ece73d01e4", "name": "network-vif-unplugged", "status": "completed", "tag": "7774938e-52d1-4c9a-8bc5-db84a905791b"}, {"server_uuid": "068f10b4-086e-4af7-a53e-f6ece73d01e4", "name": "network-vif-plugged", "status": "completed", "tag": "7774938e-52d1-4c9a-8bc5-db84a905791b"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:25:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-6bd64e69-1f86-498c-93cd-488c1f2d7183 req-8404426b-efa7-4a3f-a89e-e7b3816d775d service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-6bd64e69-1f86-498c-93cd-488c1f2d7183 req-8404426b-efa7-4a3f-a89e-e7b3816d775d service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-6bd64e69-1f86-498c-93cd-488c1f2d7183 req-8404426b-efa7-4a3f-a89e-e7b3816d775d service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:49 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-6bd64e69-1f86-498c-93cd-488c1f2d7183 req-8404426b-efa7-4a3f-a89e-e7b3816d775d service nova] Creating event network-vif-unplugged:7774938e-52d1-4c9a-8bc5-db84a905791b for instance 068f10b4-086e-4af7-a53e-f6ece73d01e4 on user Apr 11 15:25:49 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-6bd64e69-1f86-498c-93cd-488c1f2d7183 req-8404426b-efa7-4a3f-a89e-e7b3816d775d service nova] Creating event network-vif-plugged:7774938e-52d1-4c9a-8bc5-db84a905791b for instance 068f10b4-086e-4af7-a53e-f6ece73d01e4 on user Apr 11 15:25:49 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-6bd64e69-1f86-498c-93cd-488c1f2d7183 req-8404426b-efa7-4a3f-a89e-e7b3816d775d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.036465 Apr 11 15:25:49 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 92/274] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:25:49 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:25:49 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-b1da445c-3d21-4e7a-9d45-1a960701391c req-9e32c812-c819-4439-8f89-64c75a7b106c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "068f10b4-086e-4af7-a53e-f6ece73d01e4", "name": "network-vif-deleted", "tag": "7774938e-52d1-4c9a-8bc5-db84a905791b"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:25:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-b1da445c-3d21-4e7a-9d45-1a960701391c req-9e32c812-c819-4439-8f89-64c75a7b106c service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-b1da445c-3d21-4e7a-9d45-1a960701391c req-9e32c812-c819-4439-8f89-64c75a7b106c service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-b1da445c-3d21-4e7a-9d45-1a960701391c req-9e32c812-c819-4439-8f89-64c75a7b106c service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:49 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-b1da445c-3d21-4e7a-9d45-1a960701391c req-9e32c812-c819-4439-8f89-64c75a7b106c service nova] Creating event network-vif-deleted:7774938e-52d1-4c9a-8bc5-db84a905791b for instance 068f10b4-086e-4af7-a53e-f6ece73d01e4 on user Apr 11 15:25:49 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-b1da445c-3d21-4e7a-9d45-1a960701391c req-9e32c812-c819-4439-8f89-64c75a7b106c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034336 Apr 11 15:25:49 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 91/275] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:25:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:25:51 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-6b916c88-34cf-4538-bbe8-c21b19878722 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:25:51 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-6b916c88-34cf-4538-bbe8-c21b19878722 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:25:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-6b916c88-34cf-4538-bbe8-c21b19878722 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-6b916c88-34cf-4538-bbe8-c21b19878722 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-6b916c88-34cf-4538-bbe8-c21b19878722 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-6b916c88-34cf-4538-bbe8-c21b19878722 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-6b916c88-34cf-4538-bbe8-c21b19878722 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-6b916c88-34cf-4538-bbe8-c21b19878722 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:51 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-4cfea522-4591-431a-9614-f52ad14f28c8 req-8b5ec14d-bac3-443d-bb6e-08f6ac3c2327 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d90fd2-6a95-43c4-8756-e82071d99154", "name": "network-vif-plugged", "status": "completed", "tag": "4718fa68-0eb9-4592-8c43-981438e3d0b8"}, {"server_uuid": "b0d90fd2-6a95-43c4-8756-e82071d99154", "name": "network-vif-plugged", "status": "completed", "tag": "4718fa68-0eb9-4592-8c43-981438e3d0b8"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:25:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-4cfea522-4591-431a-9614-f52ad14f28c8 req-8b5ec14d-bac3-443d-bb6e-08f6ac3c2327 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-4cfea522-4591-431a-9614-f52ad14f28c8 req-8b5ec14d-bac3-443d-bb6e-08f6ac3c2327 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-4cfea522-4591-431a-9614-f52ad14f28c8 req-8b5ec14d-bac3-443d-bb6e-08f6ac3c2327 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:51 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-4cfea522-4591-431a-9614-f52ad14f28c8 req-8b5ec14d-bac3-443d-bb6e-08f6ac3c2327 service nova] Creating event network-vif-plugged:4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance b0d90fd2-6a95-43c4-8756-e82071d99154 on user Apr 11 15:25:51 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-4cfea522-4591-431a-9614-f52ad14f28c8 req-8b5ec14d-bac3-443d-bb6e-08f6ac3c2327 service nova] Creating event network-vif-plugged:4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance b0d90fd2-6a95-43c4-8756-e82071d99154 on user Apr 11 15:25:51 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-4cfea522-4591-431a-9614-f52ad14f28c8 req-8b5ec14d-bac3-443d-bb6e-08f6ac3c2327 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033429 Apr 11 15:25:51 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 93/276] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:25:51 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:25:52 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-6b916c88-34cf-4538-bbe8-c21b19878722 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2538af5c739404aa433b766976e5b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561130d089c8415297697bcedc93aefc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:25:52 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-6b916c88-34cf-4538-bbe8-c21b19878722 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4555892-7abb-4a3c-a4ae-a27ad4902708" status: 200 len: 1493 microversion: 2.1 time: 0.668808 Apr 11 15:25:52 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 93/277] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:25:51 2023] GET /compute/v2.1/servers/e4555892-7abb-4a3c-a4ae-a27ad4902708 => generated 1493 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:25:54 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-f7bc1169-7af9-4e2b-94c8-0d5b86aa21b2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:25:54 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-f7bc1169-7af9-4e2b-94c8-0d5b86aa21b2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:25:54 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f7bc1169-7af9-4e2b-94c8-0d5b86aa21b2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:54 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f7bc1169-7af9-4e2b-94c8-0d5b86aa21b2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:54 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f7bc1169-7af9-4e2b-94c8-0d5b86aa21b2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:54 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f7bc1169-7af9-4e2b-94c8-0d5b86aa21b2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:54 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f7bc1169-7af9-4e2b-94c8-0d5b86aa21b2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:54 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f7bc1169-7af9-4e2b-94c8-0d5b86aa21b2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:54 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-f7bc1169-7af9-4e2b-94c8-0d5b86aa21b2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.092327 Apr 11 15:25:54 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 92/278] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 15:25:54 2023] GET /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/os-interface => generated 282 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 15:25:54 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-0230fec5-3699-4071-843b-0d3e1976692b req-e6198e94-06b3-422e-a3c7-ace77e1b745a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d", "tag": "1ad8234a-3f96-43a0-9dea-862e6efcda73"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:25:55 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-0230fec5-3699-4071-843b-0d3e1976692b req-e6198e94-06b3-422e-a3c7-ace77e1b745a service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:55 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-0230fec5-3699-4071-843b-0d3e1976692b req-e6198e94-06b3-422e-a3c7-ace77e1b745a service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:55 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-0230fec5-3699-4071-843b-0d3e1976692b req-e6198e94-06b3-422e-a3c7-ace77e1b745a service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:55 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-0230fec5-3699-4071-843b-0d3e1976692b req-e6198e94-06b3-422e-a3c7-ace77e1b745a service nova] Creating event network-changed:1ad8234a-3f96-43a0-9dea-862e6efcda73 for instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d on user Apr 11 15:25:55 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-0230fec5-3699-4071-843b-0d3e1976692b req-e6198e94-06b3-422e-a3c7-ace77e1b745a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034528 Apr 11 15:25:55 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 94/279] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:25:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:25:55 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-084eb25e-c4a6-48b5-b03a-ea982339bd82 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:25:55 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-084eb25e-c4a6-48b5-b03a-ea982339bd82 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:25:55 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-084eb25e-c4a6-48b5-b03a-ea982339bd82 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:55 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-084eb25e-c4a6-48b5-b03a-ea982339bd82 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:55 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-084eb25e-c4a6-48b5-b03a-ea982339bd82 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:55 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-084eb25e-c4a6-48b5-b03a-ea982339bd82 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:55 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-084eb25e-c4a6-48b5-b03a-ea982339bd82 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:55 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-084eb25e-c4a6-48b5-b03a-ea982339bd82 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:55 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-084eb25e-c4a6-48b5-b03a-ea982339bd82 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/ips" status: 200 len: 109 microversion: 2.20 time: 0.040368 Apr 11 15:25:55 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 94/280] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Apr 11 15:25:55 2023] GET /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/ips => generated 109 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 15:25:56 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:25:56 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:25:56 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:56 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:56 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:56 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:56 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:56 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:56 user devstack@n-api.service[61166]: DEBUG nova.objects.instance [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lazy-loading 'flavor' on Instance uuid 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d {{(pid=61166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 15:25:57 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/action" status: 202 len: 0 microversion: 2.20 time: 0.847120 Apr 11 15:25:57 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 93/281] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 15:25:56 2023] POST /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/action => generated 0 bytes in 849 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:25:57 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-7aee30b7-809a-4496-9bf8-4ef621855c1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:25:57 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-7aee30b7-809a-4496-9bf8-4ef621855c1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:25:57 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7aee30b7-809a-4496-9bf8-4ef621855c1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:57 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7aee30b7-809a-4496-9bf8-4ef621855c1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:57 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7aee30b7-809a-4496-9bf8-4ef621855c1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:57 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7aee30b7-809a-4496-9bf8-4ef621855c1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:57 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7aee30b7-809a-4496-9bf8-4ef621855c1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:57 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7aee30b7-809a-4496-9bf8-4ef621855c1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:57 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-7aee30b7-809a-4496-9bf8-4ef621855c1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:25:57 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-7aee30b7-809a-4496-9bf8-4ef621855c1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:25:57 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-7aee30b7-809a-4496-9bf8-4ef621855c1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:25:57 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-7aee30b7-809a-4496-9bf8-4ef621855c1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" status: 200 len: 1712 microversion: 2.20 time: 0.196671 Apr 11 15:25:57 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 95/282] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:25:57 2023] GET /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d => generated 1712 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:25:57 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-b414bbd3-eed5-49d6-8939-613c33cd771c req-0483b9ef-6210-44d6-8512-29bda1a08ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d", "name": "network-vif-unplugged", "status": "completed", "tag": "1ad8234a-3f96-43a0-9dea-862e6efcda73"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:25:57 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-b414bbd3-eed5-49d6-8939-613c33cd771c req-0483b9ef-6210-44d6-8512-29bda1a08ec8 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:57 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-b414bbd3-eed5-49d6-8939-613c33cd771c req-0483b9ef-6210-44d6-8512-29bda1a08ec8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:57 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-b414bbd3-eed5-49d6-8939-613c33cd771c req-0483b9ef-6210-44d6-8512-29bda1a08ec8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:57 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-b414bbd3-eed5-49d6-8939-613c33cd771c req-0483b9ef-6210-44d6-8512-29bda1a08ec8 service nova] Creating event network-vif-unplugged:1ad8234a-3f96-43a0-9dea-862e6efcda73 for instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d on user Apr 11 15:25:57 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-b414bbd3-eed5-49d6-8939-613c33cd771c req-0483b9ef-6210-44d6-8512-29bda1a08ec8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043588 Apr 11 15:25:57 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 95/283] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:25:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:25:59 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-d034167d-5271-4c04-a1b3-4db68faba1d0 req-5bf304dd-f7d4-47ce-9762-e9aac3ae539d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d", "name": "network-vif-plugged", "status": "completed", "tag": "1ad8234a-3f96-43a0-9dea-862e6efcda73"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:25:59 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-d034167d-5271-4c04-a1b3-4db68faba1d0 req-5bf304dd-f7d4-47ce-9762-e9aac3ae539d service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:25:59 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-d034167d-5271-4c04-a1b3-4db68faba1d0 req-5bf304dd-f7d4-47ce-9762-e9aac3ae539d service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:25:59 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-d034167d-5271-4c04-a1b3-4db68faba1d0 req-5bf304dd-f7d4-47ce-9762-e9aac3ae539d service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:25:59 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-d034167d-5271-4c04-a1b3-4db68faba1d0 req-5bf304dd-f7d4-47ce-9762-e9aac3ae539d service nova] Creating event network-vif-plugged:1ad8234a-3f96-43a0-9dea-862e6efcda73 for instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d on user Apr 11 15:25:59 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-d034167d-5271-4c04-a1b3-4db68faba1d0 req-5bf304dd-f7d4-47ce-9762-e9aac3ae539d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032576 Apr 11 15:25:59 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 94/284] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:25:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:26:03 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-5c4eb084-2b6d-4bf1-b28e-6ed93c02c58c req-23e85820-4f2a-454b-8110-664c7ec7c1eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d", "tag": "1ad8234a-3f96-43a0-9dea-862e6efcda73"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:26:03 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-5c4eb084-2b6d-4bf1-b28e-6ed93c02c58c req-23e85820-4f2a-454b-8110-664c7ec7c1eb service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:03 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-5c4eb084-2b6d-4bf1-b28e-6ed93c02c58c req-23e85820-4f2a-454b-8110-664c7ec7c1eb service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:03 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-5c4eb084-2b6d-4bf1-b28e-6ed93c02c58c req-23e85820-4f2a-454b-8110-664c7ec7c1eb service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:03 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-5c4eb084-2b6d-4bf1-b28e-6ed93c02c58c req-23e85820-4f2a-454b-8110-664c7ec7c1eb service nova] Creating event network-changed:1ad8234a-3f96-43a0-9dea-862e6efcda73 for instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d on user Apr 11 15:26:03 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-5c4eb084-2b6d-4bf1-b28e-6ed93c02c58c req-23e85820-4f2a-454b-8110-664c7ec7c1eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104713 Apr 11 15:26:03 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 96/285] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:26:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:26:06 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-65cc3820-ec2b-4791-9efd-202ff90176da tempest-VolumesAdminNegativeTest-1731188693 tempest-VolumesAdminNegativeTest-1731188693-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "479fcafa-3cf9-41b8-8c41-ee560bfd3872"}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:26:06 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-65cc3820-ec2b-4791-9efd-202ff90176da tempest-VolumesAdminNegativeTest-1731188693 tempest-VolumesAdminNegativeTest-1731188693-project-admin] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:26:06 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-65cc3820-ec2b-4791-9efd-202ff90176da tempest-VolumesAdminNegativeTest-1731188693 tempest-VolumesAdminNegativeTest-1731188693-project-admin] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:06 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-65cc3820-ec2b-4791-9efd-202ff90176da tempest-VolumesAdminNegativeTest-1731188693 tempest-VolumesAdminNegativeTest-1731188693-project-admin] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:06 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-65cc3820-ec2b-4791-9efd-202ff90176da tempest-VolumesAdminNegativeTest-1731188693 tempest-VolumesAdminNegativeTest-1731188693-project-admin] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:06 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-65cc3820-ec2b-4791-9efd-202ff90176da tempest-VolumesAdminNegativeTest-1731188693 tempest-VolumesAdminNegativeTest-1731188693-project-admin] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:06 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-65cc3820-ec2b-4791-9efd-202ff90176da tempest-VolumesAdminNegativeTest-1731188693 tempest-VolumesAdminNegativeTest-1731188693-project-admin] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:06 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-65cc3820-ec2b-4791-9efd-202ff90176da tempest-VolumesAdminNegativeTest-1731188693 tempest-VolumesAdminNegativeTest-1731188693-project-admin] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:06 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-65cc3820-ec2b-4791-9efd-202ff90176da tempest-VolumesAdminNegativeTest-1731188693 tempest-VolumesAdminNegativeTest-1731188693-project-admin] HTTP exception thrown: Volume f70de7cb-730c-44b2-a4bf-aa55da1e1d1b could not be found. Apr 11 15:26:06 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-65cc3820-ec2b-4791-9efd-202ff90176da tempest-VolumesAdminNegativeTest-1731188693 tempest-VolumesAdminNegativeTest-1731188693-project-admin] Request method failure captured: Apr 11 15:26:06 user devstack@n-api.service[61167]: request: PUT /compute/v2.1/servers/b59399aa-f550-41c7-9818-6cb1f271fb52/os-volume_attachments/f70de7cb-730c-44b2-a4bf-aa55da1e1d1b HTTP/1.1 Apr 11 15:26:06 user devstack@n-api.service[61167]: Accept: application/json Apr 11 15:26:06 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 15:26:06 user devstack@n-api.service[61167]: Connection: close Apr 11 15:26:06 user devstack@n-api.service[61167]: Content-Length: 74 Apr 11 15:26:06 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 15:26:06 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 15:26:06 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 15:26:06 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 15:26:06 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNXrrYx-Hlu4Vd7DaBtQnBDDoKKG320FneejgJiPUOEB_8A0ZdYeXqjOPLHYmXwmmS5mf7dOUihs6KNDsjWPTzysShoyZTzmQ2M_3fj-1KGQ5M4MlMk_FJIYqFjHonItTytPizDw5-kdpLCXMARaoh6Y2rL_ZyovygGnCkDS30EZYcYg Apr 11 15:26:06 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 15:26:06 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 15:26:06 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 15:26:06 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 15:26:06 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 15:26:06 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 15:26:06 user devstack@n-api.service[61167]: X-Project-Id: 6f23974205a64331a9a962e5aa93ade6 Apr 11 15:26:06 user devstack@n-api.service[61167]: X-Project-Name: tempest-VolumesAdminNegativeTest-1731188693 Apr 11 15:26:06 user devstack@n-api.service[61167]: X-Role: reader,admin,member Apr 11 15:26:06 user devstack@n-api.service[61167]: X-Roles: reader,admin,member Apr 11 15:26:06 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f23974205a64331a9a962e5aa93ade6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6f23974205a64331a9a962e5aa93ade6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f23974205a64331a9a962e5aa93ade6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:26:06 user devstack@n-api.service[61167]: X-Tenant: tempest-VolumesAdminNegativeTest-1731188693 Apr 11 15:26:06 user devstack@n-api.service[61167]: X-Tenant-Id: 6f23974205a64331a9a962e5aa93ade6 Apr 11 15:26:06 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1731188693 Apr 11 15:26:06 user devstack@n-api.service[61167]: X-User: tempest-VolumesAdminNegativeTest-1731188693-project-admin Apr 11 15:26:06 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 15:26:06 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 15:26:06 user devstack@n-api.service[61167]: X-User-Id: 3f1e4ddd77034d36a2aa89a5a83ef0a2 Apr 11 15:26:06 user devstack@n-api.service[61167]: X-User-Name: tempest-VolumesAdminNegativeTest-1731188693-project-admin Apr 11 15:26:06 user devstack@n-api.service[61167]: Apr 11 15:26:06 user devstack@n-api.service[61167]: {"volumeAttachment": {"volumeId": "479fcafa-3cf9-41b8-8c41-ee560bfd3872"}} Apr 11 15:26:06 user devstack@n-api.service[61167]: method: > Apr 11 15:26:06 user devstack@n-api.service[61167]: exception: Volume f70de7cb-730c-44b2-a4bf-aa55da1e1d1b could not be found. Apr 11 15:26:06 user devstack@n-api.service[61167]: action_args: {'server_id': 'b59399aa-f550-41c7-9818-6cb1f271fb52', 'id': 'f70de7cb-730c-44b2-a4bf-aa55da1e1d1b', 'body': {'volumeAttachment': {'volumeId': '479fcafa-3cf9-41b8-8c41-ee560bfd3872'}}} Apr 11 15:26:06 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f70de7cb-730c-44b2-a4bf-aa55da1e1d1b could not be found. (HTTP 404) (Request-ID: req-0b9d928f-3ed6-4eaa-a5cd-27fa93e65bf9) Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f70de7cb-730c-44b2-a4bf-aa55da1e1d1b could not be found. Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f70de7cb-730c-44b2-a4bf-aa55da1e1d1b could not be found. Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f70de7cb-730c-44b2-a4bf-aa55da1e1d1b could not be found. Apr 11 15:26:06 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:26:06 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-65cc3820-ec2b-4791-9efd-202ff90176da tempest-VolumesAdminNegativeTest-1731188693 tempest-VolumesAdminNegativeTest-1731188693-project-admin] Returning 404 to user: Volume f70de7cb-730c-44b2-a4bf-aa55da1e1d1b could not be found. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:26:06 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-65cc3820-ec2b-4791-9efd-202ff90176da tempest-VolumesAdminNegativeTest-1731188693 tempest-VolumesAdminNegativeTest-1731188693-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/b59399aa-f550-41c7-9818-6cb1f271fb52/os-volume_attachments/f70de7cb-730c-44b2-a4bf-aa55da1e1d1b" status: 404 len: 109 microversion: 2.1 time: 0.111518 Apr 11 15:26:06 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 96/286] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Apr 11 15:26:06 2023] PUT /compute/v2.1/servers/b59399aa-f550-41c7-9818-6cb1f271fb52/os-volume_attachments/f70de7cb-730c-44b2-a4bf-aa55da1e1d1b => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:26:07 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:26:07 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:26:07 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:07 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:07 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:07 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:07 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:07 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:07 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Going to try to terminate instance {{(pid=61166) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:26:07 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b59399aa-f550-41c7-9818-6cb1f271fb52" status: 204 len: 0 microversion: 2.1 time: 0.142724 Apr 11 15:26:07 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 95/287] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:26:07 2023] DELETE /compute/v2.1/servers/b59399aa-f550-41c7-9818-6cb1f271fb52 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 11 15:26:07 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-c25245de-54ce-4852-a97a-c9618826e666 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:26:07 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-c25245de-54ce-4852-a97a-c9618826e666 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:26:07 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c25245de-54ce-4852-a97a-c9618826e666 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:07 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c25245de-54ce-4852-a97a-c9618826e666 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:07 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c25245de-54ce-4852-a97a-c9618826e666 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:07 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c25245de-54ce-4852-a97a-c9618826e666 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:07 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c25245de-54ce-4852-a97a-c9618826e666 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:07 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c25245de-54ce-4852-a97a-c9618826e666 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:07 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-c25245de-54ce-4852-a97a-c9618826e666 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2717e456dcc941899c48c3c973083bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da140971126a4d298ff718275e7a22ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:26:07 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-c25245de-54ce-4852-a97a-c9618826e666 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b59399aa-f550-41c7-9818-6cb1f271fb52" status: 200 len: 1502 microversion: 2.1 time: 0.228447 Apr 11 15:26:07 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 97/288] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:26:07 2023] GET /compute/v2.1/servers/b59399aa-f550-41c7-9818-6cb1f271fb52 => generated 1502 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:26:07 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-35f97a3b-bbf6-419f-af85-3de55f7f8a47 req-a4d15fe5-4210-43b1-961a-a282e26425ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b59399aa-f550-41c7-9818-6cb1f271fb52", "name": "network-vif-unplugged", "status": "completed", "tag": "ae63c1ed-23df-4140-979f-1756e27a67e1"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:26:07 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-35f97a3b-bbf6-419f-af85-3de55f7f8a47 req-a4d15fe5-4210-43b1-961a-a282e26425ac service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:07 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-35f97a3b-bbf6-419f-af85-3de55f7f8a47 req-a4d15fe5-4210-43b1-961a-a282e26425ac service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:07 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-35f97a3b-bbf6-419f-af85-3de55f7f8a47 req-a4d15fe5-4210-43b1-961a-a282e26425ac service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:07 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-35f97a3b-bbf6-419f-af85-3de55f7f8a47 req-a4d15fe5-4210-43b1-961a-a282e26425ac service nova] Creating event network-vif-unplugged:ae63c1ed-23df-4140-979f-1756e27a67e1 for instance b59399aa-f550-41c7-9818-6cb1f271fb52 on user Apr 11 15:26:07 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-35f97a3b-bbf6-419f-af85-3de55f7f8a47 req-a4d15fe5-4210-43b1-961a-a282e26425ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091883 Apr 11 15:26:07 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 97/289] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:26:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:26:08 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-8699deae-86fd-4f06-ae4d-1d4d44c60bb6 req-98284667-2cc9-4130-b9ea-8d3a292bd69f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b59399aa-f550-41c7-9818-6cb1f271fb52", "name": "network-vif-deleted", "tag": "ae63c1ed-23df-4140-979f-1756e27a67e1"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:26:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-8699deae-86fd-4f06-ae4d-1d4d44c60bb6 req-98284667-2cc9-4130-b9ea-8d3a292bd69f service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-8699deae-86fd-4f06-ae4d-1d4d44c60bb6 req-98284667-2cc9-4130-b9ea-8d3a292bd69f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-8699deae-86fd-4f06-ae4d-1d4d44c60bb6 req-98284667-2cc9-4130-b9ea-8d3a292bd69f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:08 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-8699deae-86fd-4f06-ae4d-1d4d44c60bb6 req-98284667-2cc9-4130-b9ea-8d3a292bd69f service nova] Creating event network-vif-deleted:ae63c1ed-23df-4140-979f-1756e27a67e1 for instance b59399aa-f550-41c7-9818-6cb1f271fb52 on user Apr 11 15:26:08 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-8699deae-86fd-4f06-ae4d-1d4d44c60bb6 req-98284667-2cc9-4130-b9ea-8d3a292bd69f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035022 Apr 11 15:26:08 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 96/290] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:26:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:26:09 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-8071e801-17bb-4089-bfe9-c6b37cac70f7 req-3a102942-a8bd-4c6a-a632-adba1a74d8aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b59399aa-f550-41c7-9818-6cb1f271fb52", "name": "network-vif-plugged", "status": "completed", "tag": "ae63c1ed-23df-4140-979f-1756e27a67e1"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:26:09 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-8071e801-17bb-4089-bfe9-c6b37cac70f7 req-3a102942-a8bd-4c6a-a632-adba1a74d8aa service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:09 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-8071e801-17bb-4089-bfe9-c6b37cac70f7 req-3a102942-a8bd-4c6a-a632-adba1a74d8aa service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:09 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-8071e801-17bb-4089-bfe9-c6b37cac70f7 req-3a102942-a8bd-4c6a-a632-adba1a74d8aa service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:09 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-8071e801-17bb-4089-bfe9-c6b37cac70f7 req-3a102942-a8bd-4c6a-a632-adba1a74d8aa service nova] Creating event network-vif-plugged:ae63c1ed-23df-4140-979f-1756e27a67e1 for instance b59399aa-f550-41c7-9818-6cb1f271fb52 on user Apr 11 15:26:09 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-8071e801-17bb-4089-bfe9-c6b37cac70f7 req-3a102942-a8bd-4c6a-a632-adba1a74d8aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032772 Apr 11 15:26:09 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 98/291] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:26:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:26:32 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=16 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:26:32 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:26:32 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-87486a27-bf3b-4253-a53c-14fb9ca81cb2 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:26:32 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-87486a27-bf3b-4253-a53c-14fb9ca81cb2 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:26:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-87486a27-bf3b-4253-a53c-14fb9ca81cb2 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-87486a27-bf3b-4253-a53c-14fb9ca81cb2 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-87486a27-bf3b-4253-a53c-14fb9ca81cb2 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-87486a27-bf3b-4253-a53c-14fb9ca81cb2 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-87486a27-bf3b-4253-a53c-14fb9ca81cb2 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-87486a27-bf3b-4253-a53c-14fb9ca81cb2 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:32 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-87486a27-bf3b-4253-a53c-14fb9ca81cb2 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e1716b2bb2438b93d46dc8052c788b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ed867a40534b70bf75dc0cc28fdfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:26:32 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-87486a27-bf3b-4253-a53c-14fb9ca81cb2 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39e3dfb1-bc09-474d-b8cb-f01b11923eae" status: 200 len: 1435 microversion: 2.1 time: 0.181079 Apr 11 15:26:32 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 98/292] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:26:32 2023] GET /compute/v2.1/servers/39e3dfb1-bc09-474d-b8cb-f01b11923eae => generated 1435 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:26:33 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:26:33 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:26:34 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-22f58356-a22e-4580-8058-a75cb81509bf req-c50f7cd7-a5d9-4544-948d-3bf8d8a2b98c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39e3dfb1-bc09-474d-b8cb-f01b11923eae", "tag": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:26:34 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:26:34 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-22f58356-a22e-4580-8058-a75cb81509bf req-c50f7cd7-a5d9-4544-948d-3bf8d8a2b98c service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:34 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-22f58356-a22e-4580-8058-a75cb81509bf req-c50f7cd7-a5d9-4544-948d-3bf8d8a2b98c service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:34 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-22f58356-a22e-4580-8058-a75cb81509bf req-c50f7cd7-a5d9-4544-948d-3bf8d8a2b98c service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:34 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:26:34 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:26:34 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:26:34 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-22f58356-a22e-4580-8058-a75cb81509bf req-c50f7cd7-a5d9-4544-948d-3bf8d8a2b98c service nova] Creating event network-changed:21d628ba-6bae-4d98-94df-bb6fbb4f1c24 for instance 39e3dfb1-bc09-474d-b8cb-f01b11923eae on user Apr 11 15:26:34 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-22f58356-a22e-4580-8058-a75cb81509bf req-c50f7cd7-a5d9-4544-948d-3bf8d8a2b98c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199375 Apr 11 15:26:34 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 97/293] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:26:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:26:34 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:34 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:34 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:34 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:34 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:34 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:34 user devstack@n-api.service[61165]: DEBUG nova.objects.instance [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lazy-loading 'flavor' on Instance uuid 39e3dfb1-bc09-474d-b8cb-f01b11923eae {{(pid=61165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 15:26:34 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] 10.0.0.210 "POST /compute/v2.1/servers/39e3dfb1-bc09-474d-b8cb-f01b11923eae/action" status: 202 len: 0 microversion: 2.1 time: 0.157462 Apr 11 15:26:34 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 99/294] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 15:26:34 2023] POST /compute/v2.1/servers/39e3dfb1-bc09-474d-b8cb-f01b11923eae/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:26:34 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-0980d08f-61e4-4e32-994b-4e9e594c81c9 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:26:34 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-0980d08f-61e4-4e32-994b-4e9e594c81c9 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:26:34 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-0980d08f-61e4-4e32-994b-4e9e594c81c9 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:34 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-0980d08f-61e4-4e32-994b-4e9e594c81c9 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:34 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-0980d08f-61e4-4e32-994b-4e9e594c81c9 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:34 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-0980d08f-61e4-4e32-994b-4e9e594c81c9 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:34 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-0980d08f-61e4-4e32-994b-4e9e594c81c9 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:34 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-0980d08f-61e4-4e32-994b-4e9e594c81c9 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:34 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-0980d08f-61e4-4e32-994b-4e9e594c81c9 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e1716b2bb2438b93d46dc8052c788b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ed867a40534b70bf75dc0cc28fdfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:26:34 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-0980d08f-61e4-4e32-994b-4e9e594c81c9 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39e3dfb1-bc09-474d-b8cb-f01b11923eae" status: 200 len: 1441 microversion: 2.1 time: 0.265210 Apr 11 15:26:34 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 99/295] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:26:34 2023] GET /compute/v2.1/servers/39e3dfb1-bc09-474d-b8cb-f01b11923eae => generated 1441 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:26:35 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-bc7bc5ae-0fbb-4424-9940-54c9798cb78c tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:26:35 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-bc7bc5ae-0fbb-4424-9940-54c9798cb78c tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:26:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-bc7bc5ae-0fbb-4424-9940-54c9798cb78c tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-bc7bc5ae-0fbb-4424-9940-54c9798cb78c tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-bc7bc5ae-0fbb-4424-9940-54c9798cb78c tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-bc7bc5ae-0fbb-4424-9940-54c9798cb78c tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-bc7bc5ae-0fbb-4424-9940-54c9798cb78c tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-bc7bc5ae-0fbb-4424-9940-54c9798cb78c tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:35 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-bc7bc5ae-0fbb-4424-9940-54c9798cb78c tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:26:35 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-bc7bc5ae-0fbb-4424-9940-54c9798cb78c tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:26:35 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-bc7bc5ae-0fbb-4424-9940-54c9798cb78c tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:26:35 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-bc7bc5ae-0fbb-4424-9940-54c9798cb78c tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0d90fd2-6a95-43c4-8756-e82071d99154" status: 200 len: 1754 microversion: 2.87 time: 0.871985 Apr 11 15:26:35 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 98/296] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:26:35 2023] GET /compute/v2.1/servers/b0d90fd2-6a95-43c4-8756-e82071d99154 => generated 1754 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:26:36 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-a5d7ee98-82ad-4371-ba36-2cea7e13225c req-2f8a1c04-c72b-4fac-b47b-a5e8d0350301 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e3dfb1-bc09-474d-b8cb-f01b11923eae", "name": "network-vif-unplugged", "status": "completed", "tag": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24"}, {"server_uuid": "39e3dfb1-bc09-474d-b8cb-f01b11923eae", "name": "network-vif-plugged", "status": "completed", "tag": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:26:36 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-a5d7ee98-82ad-4371-ba36-2cea7e13225c req-2f8a1c04-c72b-4fac-b47b-a5e8d0350301 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:36 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-a5d7ee98-82ad-4371-ba36-2cea7e13225c req-2f8a1c04-c72b-4fac-b47b-a5e8d0350301 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:36 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-a5d7ee98-82ad-4371-ba36-2cea7e13225c req-2f8a1c04-c72b-4fac-b47b-a5e8d0350301 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:36 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-a5d7ee98-82ad-4371-ba36-2cea7e13225c req-2f8a1c04-c72b-4fac-b47b-a5e8d0350301 service nova] Creating event network-vif-unplugged:21d628ba-6bae-4d98-94df-bb6fbb4f1c24 for instance 39e3dfb1-bc09-474d-b8cb-f01b11923eae on user Apr 11 15:26:36 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-a5d7ee98-82ad-4371-ba36-2cea7e13225c req-2f8a1c04-c72b-4fac-b47b-a5e8d0350301 service nova] Creating event network-vif-plugged:21d628ba-6bae-4d98-94df-bb6fbb4f1c24 for instance 39e3dfb1-bc09-474d-b8cb-f01b11923eae on user Apr 11 15:26:36 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-a5d7ee98-82ad-4371-ba36-2cea7e13225c req-2f8a1c04-c72b-4fac-b47b-a5e8d0350301 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.032979 Apr 11 15:26:36 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 100/297] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:26:36 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:26:36 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-4be2a3db-380a-4ddb-b14e-7ba17bd19f04 req-d4f8083d-9510-4501-b729-287651f5046e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39e3dfb1-bc09-474d-b8cb-f01b11923eae", "tag": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:26:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-4be2a3db-380a-4ddb-b14e-7ba17bd19f04 req-d4f8083d-9510-4501-b729-287651f5046e service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-4be2a3db-380a-4ddb-b14e-7ba17bd19f04 req-d4f8083d-9510-4501-b729-287651f5046e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-4be2a3db-380a-4ddb-b14e-7ba17bd19f04 req-d4f8083d-9510-4501-b729-287651f5046e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:36 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-4be2a3db-380a-4ddb-b14e-7ba17bd19f04 req-d4f8083d-9510-4501-b729-287651f5046e service nova] Creating event network-changed:21d628ba-6bae-4d98-94df-bb6fbb4f1c24 for instance 39e3dfb1-bc09-474d-b8cb-f01b11923eae on user Apr 11 15:26:36 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-4be2a3db-380a-4ddb-b14e-7ba17bd19f04 req-d4f8083d-9510-4501-b729-287651f5046e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.026999 Apr 11 15:26:36 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 100/298] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:26:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:26:38 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-6d092fc0-0092-4e6a-bbd0-6df30dd1fa91 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:26:38 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-6d092fc0-0092-4e6a-bbd0-6df30dd1fa91 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:26:38 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-6d092fc0-0092-4e6a-bbd0-6df30dd1fa91 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:38 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-6d092fc0-0092-4e6a-bbd0-6df30dd1fa91 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:38 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-6d092fc0-0092-4e6a-bbd0-6df30dd1fa91 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:38 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-6d092fc0-0092-4e6a-bbd0-6df30dd1fa91 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:38 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-6d092fc0-0092-4e6a-bbd0-6df30dd1fa91 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:38 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-6d092fc0-0092-4e6a-bbd0-6df30dd1fa91 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:38 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-6d092fc0-0092-4e6a-bbd0-6df30dd1fa91 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] HTTP exception thrown: Instance 068f10b4-086e-4af7-a53e-f6ece73d01e4 could not be found. Apr 11 15:26:38 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1343431818", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "networks": [{"uuid": "80c5b877-1e8a-4e8f-8490-7cb77946f044"}]}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:26:38 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-6d092fc0-0092-4e6a-bbd0-6df30dd1fa91 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Request method failure captured: Apr 11 15:26:38 user devstack@n-api.service[61166]: request: GET /compute/v2.1/servers/068f10b4-086e-4af7-a53e-f6ece73d01e4 HTTP/1.1 Apr 11 15:26:38 user devstack@n-api.service[61166]: Accept: application/json Apr 11 15:26:38 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 15:26:38 user devstack@n-api.service[61166]: Connection: close Apr 11 15:26:38 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 15:26:38 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 15:26:38 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 15:26:38 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 15:26:38 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 15:26:38 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNXrnSgO-fOJ9yzzthdf4KOEghm0slg-6cmjwR8dtVB-7Q614oG6SUy8HyvFhtQBN7-S12HpP2EQbYgaEX_gMfpuysGRqFiah3fU8u5ZIQh07JGvmpTFx3UYZPxJ3Pz9p9zMZ_m-eV1L-xRsHMqG7yn1CWP9hdNdU2h1BNCz_HXA_qPg Apr 11 15:26:38 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 15:26:38 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 15:26:38 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 15:26:38 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 15:26:38 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 15:26:38 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 15:26:38 user devstack@n-api.service[61166]: X-Project-Id: b4a341ccfc0b4f08bb2e97083143dd40 Apr 11 15:26:38 user devstack@n-api.service[61166]: X-Project-Name: tempest-VolumesActionsTest-1278032672 Apr 11 15:26:38 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 15:26:38 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 15:26:38 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4a341ccfc0b4f08bb2e97083143dd40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b4a341ccfc0b4f08bb2e97083143dd40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4a341ccfc0b4f08bb2e97083143dd40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:26:38 user devstack@n-api.service[61166]: X-Tenant: tempest-VolumesActionsTest-1278032672 Apr 11 15:26:38 user devstack@n-api.service[61166]: X-Tenant-Id: b4a341ccfc0b4f08bb2e97083143dd40 Apr 11 15:26:38 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-VolumesActionsTest-1278032672 Apr 11 15:26:38 user devstack@n-api.service[61166]: X-User: tempest-VolumesActionsTest-1278032672-project-member Apr 11 15:26:38 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 15:26:38 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 15:26:38 user devstack@n-api.service[61166]: X-User-Id: acc44d2042554ca0b0bde4b2de5b566a Apr 11 15:26:38 user devstack@n-api.service[61166]: X-User-Name: tempest-VolumesActionsTest-1278032672-project-member Apr 11 15:26:38 user devstack@n-api.service[61166]: method: > Apr 11 15:26:38 user devstack@n-api.service[61166]: exception: Instance 068f10b4-086e-4af7-a53e-f6ece73d01e4 could not be found. Apr 11 15:26:38 user devstack@n-api.service[61166]: action_args: {'id': '068f10b4-086e-4af7-a53e-f6ece73d01e4'} Apr 11 15:26:38 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 068f10b4-086e-4af7-a53e-f6ece73d01e4 could not be found. Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 068f10b4-086e-4af7-a53e-f6ece73d01e4 could not be found. Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 068f10b4-086e-4af7-a53e-f6ece73d01e4 could not be found. Apr 11 15:26:38 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:26:38 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-6d092fc0-0092-4e6a-bbd0-6df30dd1fa91 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Returning 404 to user: Instance 068f10b4-086e-4af7-a53e-f6ece73d01e4 could not be found. {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:26:38 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-6d092fc0-0092-4e6a-bbd0-6df30dd1fa91 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] 10.0.0.210 "GET /compute/v2.1/servers/068f10b4-086e-4af7-a53e-f6ece73d01e4" status: 404 len: 111 microversion: 2.1 time: 0.323183 Apr 11 15:26:38 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 99/299] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:26:38 2023] GET /compute/v2.1/servers/068f10b4-086e-4af7-a53e-f6ece73d01e4 => generated 111 bytes in 324 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:26:38 user devstack@n-api.service[61165]: DEBUG nova.network.neutron [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] validate_networks() for [('80c5b877-1e8a-4e8f-8490-7cb77946f044', None, None, None, None, None)] {{(pid=61165) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:26:39 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Flavor limits 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:26:39 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Image limits 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:26:39 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Flavor pref 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:26:39 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Image pref 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:26:39 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:26:39 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:39 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:39 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:39 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:39 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:39 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:39 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Getting quotas for project 14c9c879d28040aba0ebc76bc2a80693. Resources: {'instances', 'cores', 'ram'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:26:39 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Getting quotas for user 90c7f9af6776413c91e2638712a142f7 and project 14c9c879d28040aba0ebc76bc2a80693. Resources: {'instances', 'cores', 'ram'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:26:39 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Going to run 1 instances... {{(pid=61165) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:26:39 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52fe638c-5ada-47d5-b376-233bfa808a37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61165) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:26:39 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.646725 Apr 11 15:26:39 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 101/300] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 15:26:38 2023] POST /compute/v2.1/servers => generated 378 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 15:26:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-bb934ca8-8dd9-4def-bfe2-d1645cf05711 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:26:39 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-bb934ca8-8dd9-4def-bfe2-d1645cf05711 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:26:39 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-bb934ca8-8dd9-4def-bfe2-d1645cf05711 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c7f9af6776413c91e2638712a142f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c879d28040aba0ebc76bc2a80693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:26:39 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-bb934ca8-8dd9-4def-bfe2-d1645cf05711 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5" status: 200 len: 1208 microversion: 2.1 time: 0.080119 Apr 11 15:26:39 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 101/301] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:26:39 2023] GET /compute/v2.1/servers/fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5 => generated 1208 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:26:41 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-6652633c-178d-4a1c-8d48-795807cea8bd req-d2c86925-85db-49c4-9782-a969627a9cee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5", "tag": "836289ee-6293-49b3-b0c2-7012ceae0c97"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:26:41 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-6652633c-178d-4a1c-8d48-795807cea8bd req-d2c86925-85db-49c4-9782-a969627a9cee service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:41 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-6652633c-178d-4a1c-8d48-795807cea8bd req-d2c86925-85db-49c4-9782-a969627a9cee service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:41 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-6652633c-178d-4a1c-8d48-795807cea8bd req-d2c86925-85db-49c4-9782-a969627a9cee service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:41 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-6652633c-178d-4a1c-8d48-795807cea8bd req-d2c86925-85db-49c4-9782-a969627a9cee service nova] Creating event network-changed:836289ee-6293-49b3-b0c2-7012ceae0c97 for instance fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5 on user Apr 11 15:26:41 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-6652633c-178d-4a1c-8d48-795807cea8bd req-d2c86925-85db-49c4-9782-a969627a9cee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034697 Apr 11 15:26:41 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 100/302] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:26:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:26:43 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-bf3e48c3-7f09-4026-8b01-092027b5c2d0 req-e885c760-31cf-4dfd-8627-9050a81212ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5", "name": "network-vif-plugged", "status": "completed", "tag": "836289ee-6293-49b3-b0c2-7012ceae0c97"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:26:43 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-bf3e48c3-7f09-4026-8b01-092027b5c2d0 req-e885c760-31cf-4dfd-8627-9050a81212ac service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:43 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-bf3e48c3-7f09-4026-8b01-092027b5c2d0 req-e885c760-31cf-4dfd-8627-9050a81212ac service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:43 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-bf3e48c3-7f09-4026-8b01-092027b5c2d0 req-e885c760-31cf-4dfd-8627-9050a81212ac service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:43 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-bf3e48c3-7f09-4026-8b01-092027b5c2d0 req-e885c760-31cf-4dfd-8627-9050a81212ac service nova] Creating event network-vif-plugged:836289ee-6293-49b3-b0c2-7012ceae0c97 for instance fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5 on user Apr 11 15:26:43 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-bf3e48c3-7f09-4026-8b01-092027b5c2d0 req-e885c760-31cf-4dfd-8627-9050a81212ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032597 Apr 11 15:26:43 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 102/303] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:26:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:26:45 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-df83a829-0c3b-43bf-8fb3-7720fab82698 req-763df361-e76b-4c05-bfe4-86d38ef7da90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5", "name": "network-vif-plugged", "status": "completed", "tag": "836289ee-6293-49b3-b0c2-7012ceae0c97"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:26:45 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-df83a829-0c3b-43bf-8fb3-7720fab82698 req-763df361-e76b-4c05-bfe4-86d38ef7da90 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:45 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-df83a829-0c3b-43bf-8fb3-7720fab82698 req-763df361-e76b-4c05-bfe4-86d38ef7da90 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:45 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-df83a829-0c3b-43bf-8fb3-7720fab82698 req-763df361-e76b-4c05-bfe4-86d38ef7da90 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:45 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-df83a829-0c3b-43bf-8fb3-7720fab82698 req-763df361-e76b-4c05-bfe4-86d38ef7da90 service nova] Creating event network-vif-plugged:836289ee-6293-49b3-b0c2-7012ceae0c97 for instance fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5 on user Apr 11 15:26:45 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-df83a829-0c3b-43bf-8fb3-7720fab82698 req-763df361-e76b-4c05-bfe4-86d38ef7da90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030134 Apr 11 15:26:45 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 102/304] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:26:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:26:47 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-04eadac0-11be-40f8-9e0b-d9de64f26620 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:26:47 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-04eadac0-11be-40f8-9e0b-d9de64f26620 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:26:47 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-04eadac0-11be-40f8-9e0b-d9de64f26620 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:47 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-04eadac0-11be-40f8-9e0b-d9de64f26620 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:47 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-04eadac0-11be-40f8-9e0b-d9de64f26620 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:47 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-04eadac0-11be-40f8-9e0b-d9de64f26620 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:47 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-04eadac0-11be-40f8-9e0b-d9de64f26620 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:47 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-04eadac0-11be-40f8-9e0b-d9de64f26620 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:47 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-04eadac0-11be-40f8-9e0b-d9de64f26620 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:26:47 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-04eadac0-11be-40f8-9e0b-d9de64f26620 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:26:47 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-04eadac0-11be-40f8-9e0b-d9de64f26620 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:26:47 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-04eadac0-11be-40f8-9e0b-d9de64f26620 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" status: 200 len: 1653 microversion: 2.20 time: 0.192875 Apr 11 15:26:47 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 101/305] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:26:47 2023] GET /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d => generated 1653 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:26:48 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-fa5c1d87-9e3f-4e50-bf10-f71f4a0da263 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:26:48 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-fa5c1d87-9e3f-4e50-bf10-f71f4a0da263 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:26:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-fa5c1d87-9e3f-4e50-bf10-f71f4a0da263 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-fa5c1d87-9e3f-4e50-bf10-f71f4a0da263 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-fa5c1d87-9e3f-4e50-bf10-f71f4a0da263 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-fa5c1d87-9e3f-4e50-bf10-f71f4a0da263 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-fa5c1d87-9e3f-4e50-bf10-f71f4a0da263 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-fa5c1d87-9e3f-4e50-bf10-f71f4a0da263 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:49 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-fa5c1d87-9e3f-4e50-bf10-f71f4a0da263 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:26:49 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-fa5c1d87-9e3f-4e50-bf10-f71f4a0da263 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35" status: 200 len: 1723 microversion: 2.1 time: 0.272668 Apr 11 15:26:49 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 103/306] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:26:48 2023] GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35 => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:26:49 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-3ccc9309-0d74-4011-87f9-946a760b459c tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:26:49 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-3ccc9309-0d74-4011-87f9-946a760b459c tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:26:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-3ccc9309-0d74-4011-87f9-946a760b459c tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-3ccc9309-0d74-4011-87f9-946a760b459c tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-3ccc9309-0d74-4011-87f9-946a760b459c tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-3ccc9309-0d74-4011-87f9-946a760b459c tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-3ccc9309-0d74-4011-87f9-946a760b459c tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-3ccc9309-0d74-4011-87f9-946a760b459c tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:49 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:26:49 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-3ccc9309-0d74-4011-87f9-946a760b459c tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:26:49 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-3ccc9309-0d74-4011-87f9-946a760b459c tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35" status: 200 len: 1723 microversion: 2.1 time: 0.193184 Apr 11 15:26:49 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 103/307] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:26:49 2023] GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:26:52 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-791973205", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "networks": [{"uuid": "f9b1d398-27cb-42de-9d95-0e031b1bd6ec"}]}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:26:52 user devstack@n-api.service[61166]: DEBUG nova.network.neutron [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] validate_networks() for [('f9b1d398-27cb-42de-9d95-0e031b1bd6ec', None, None, None, None, None)] {{(pid=61166) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:26:52 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Flavor limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:26:52 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Image limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:26:52 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Flavor pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:26:52 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Image pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:26:52 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:26:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:52 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Getting quotas for project 561130d089c8415297697bcedc93aefc. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:26:52 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Getting quotas for user b2538af5c739404aa433b766976e5b2d and project 561130d089c8415297697bcedc93aefc. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:26:52 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Going to run 1 instances... {{(pid=61166) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:26:52 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52fe638c-5ada-47d5-b376-233bfa808a37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:26:53 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.691803 Apr 11 15:26:53 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 102/308] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 15:26:52 2023] POST /compute/v2.1/servers => generated 378 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 15:26:53 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-70a921c4-3686-4846-9745-93d33d1abeaa tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:26:53 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-70a921c4-3686-4846-9745-93d33d1abeaa tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:26:53 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:26:53 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:26:53 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-70a921c4-3686-4846-9745-93d33d1abeaa tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2538af5c739404aa433b766976e5b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561130d089c8415297697bcedc93aefc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:26:53 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-70a921c4-3686-4846-9745-93d33d1abeaa tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f846ecc9-ecc4-4e8f-aca3-39d83b56f414" status: 200 len: 1210 microversion: 2.1 time: 0.076995 Apr 11 15:26:53 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 104/309] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:26:53 2023] GET /compute/v2.1/servers/f846ecc9-ecc4-4e8f-aca3-39d83b56f414 => generated 1210 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:26:55 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-bbdcbb1a-b73e-4253-a2bd-301b075ae4c2 req-3c85ad82-67d9-4d1c-b9c2-82434b042852 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f846ecc9-ecc4-4e8f-aca3-39d83b56f414", "tag": "ce99a25f-dfdb-4798-8830-d2f4a66e6cc8"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:26:55 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-bbdcbb1a-b73e-4253-a2bd-301b075ae4c2 req-3c85ad82-67d9-4d1c-b9c2-82434b042852 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:55 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-bbdcbb1a-b73e-4253-a2bd-301b075ae4c2 req-3c85ad82-67d9-4d1c-b9c2-82434b042852 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:55 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-bbdcbb1a-b73e-4253-a2bd-301b075ae4c2 req-3c85ad82-67d9-4d1c-b9c2-82434b042852 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:55 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-bbdcbb1a-b73e-4253-a2bd-301b075ae4c2 req-3c85ad82-67d9-4d1c-b9c2-82434b042852 service nova] Creating event network-changed:ce99a25f-dfdb-4798-8830-d2f4a66e6cc8 for instance f846ecc9-ecc4-4e8f-aca3-39d83b56f414 on user Apr 11 15:26:55 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-bbdcbb1a-b73e-4253-a2bd-301b075ae4c2 req-3c85ad82-67d9-4d1c-b9c2-82434b042852 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033157 Apr 11 15:26:55 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 104/310] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:26:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:26:58 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-1bae516d-6c50-495e-99b7-1bd9fdae2f91 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:26:58 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-1bae516d-6c50-495e-99b7-1bd9fdae2f91 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:26:58 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1bae516d-6c50-495e-99b7-1bd9fdae2f91 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:58 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1bae516d-6c50-495e-99b7-1bd9fdae2f91 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:58 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1bae516d-6c50-495e-99b7-1bd9fdae2f91 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:58 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1bae516d-6c50-495e-99b7-1bd9fdae2f91 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:58 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1bae516d-6c50-495e-99b7-1bd9fdae2f91 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:58 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1bae516d-6c50-495e-99b7-1bd9fdae2f91 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:58 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-1bae516d-6c50-495e-99b7-1bd9fdae2f91 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] HTTP exception thrown: Instance b59399aa-f550-41c7-9818-6cb1f271fb52 could not be found. Apr 11 15:26:58 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-1bae516d-6c50-495e-99b7-1bd9fdae2f91 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Request method failure captured: Apr 11 15:26:58 user devstack@n-api.service[61166]: request: GET /compute/v2.1/servers/b59399aa-f550-41c7-9818-6cb1f271fb52 HTTP/1.1 Apr 11 15:26:58 user devstack@n-api.service[61166]: Accept: application/json Apr 11 15:26:58 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 15:26:58 user devstack@n-api.service[61166]: Connection: close Apr 11 15:26:58 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 15:26:58 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 15:26:58 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 15:26:58 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 15:26:58 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 15:26:58 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNXrT8SpyxJL1DGpzBjmmuzZjpqrAIuOto9ecrwnpeJEzp_iHzsoc2OCJVt8uKcjAXGMxk0pRgJoG21wHVXlfVVC7KN6GVhKTaa0z-GBISHZqMBfUOTr3S0jjiQdJBTyK9NRah0CixnNWPRessogyZfRqBUAYYEoJVGmAzrTu0TL8ktI Apr 11 15:26:58 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 15:26:58 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 15:26:58 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 15:26:58 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 15:26:58 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 15:26:58 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 15:26:58 user devstack@n-api.service[61166]: X-Project-Id: da140971126a4d298ff718275e7a22ec Apr 11 15:26:58 user devstack@n-api.service[61166]: X-Project-Name: tempest-VolumesAdminNegativeTest-2033224639 Apr 11 15:26:58 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 15:26:58 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 15:26:58 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/da140971126a4d298ff718275e7a22ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/da140971126a4d298ff718275e7a22ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/da140971126a4d298ff718275e7a22ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:26:58 user devstack@n-api.service[61166]: X-Tenant: tempest-VolumesAdminNegativeTest-2033224639 Apr 11 15:26:58 user devstack@n-api.service[61166]: X-Tenant-Id: da140971126a4d298ff718275e7a22ec Apr 11 15:26:58 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2033224639 Apr 11 15:26:58 user devstack@n-api.service[61166]: X-User: tempest-VolumesAdminNegativeTest-2033224639-project-member Apr 11 15:26:58 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 15:26:58 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 15:26:58 user devstack@n-api.service[61166]: X-User-Id: 2717e456dcc941899c48c3c973083bd4 Apr 11 15:26:58 user devstack@n-api.service[61166]: X-User-Name: tempest-VolumesAdminNegativeTest-2033224639-project-member Apr 11 15:26:58 user devstack@n-api.service[61166]: method: > Apr 11 15:26:58 user devstack@n-api.service[61166]: exception: Instance b59399aa-f550-41c7-9818-6cb1f271fb52 could not be found. Apr 11 15:26:58 user devstack@n-api.service[61166]: action_args: {'id': 'b59399aa-f550-41c7-9818-6cb1f271fb52'} Apr 11 15:26:58 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b59399aa-f550-41c7-9818-6cb1f271fb52 could not be found. Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b59399aa-f550-41c7-9818-6cb1f271fb52 could not be found. Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b59399aa-f550-41c7-9818-6cb1f271fb52 could not be found. Apr 11 15:26:58 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:26:58 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-1bae516d-6c50-495e-99b7-1bd9fdae2f91 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Returning 404 to user: Instance b59399aa-f550-41c7-9818-6cb1f271fb52 could not be found. {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:26:58 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-1bae516d-6c50-495e-99b7-1bd9fdae2f91 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b59399aa-f550-41c7-9818-6cb1f271fb52" status: 404 len: 111 microversion: 2.1 time: 0.273723 Apr 11 15:26:58 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 103/311] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:26:57 2023] GET /compute/v2.1/servers/b59399aa-f550-41c7-9818-6cb1f271fb52 => generated 111 bytes in 275 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:26:59 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:26:59 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:26:59 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:26:59 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:59 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:59 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:59 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:59 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:59 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:59 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Going to try to terminate instance {{(pid=61165) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:26:59 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-d46a35a2-2a47-4ecf-8bb0-2fd401272ffd req-8f21a29b-2808-4c88-85b3-b7bdcfee8154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f846ecc9-ecc4-4e8f-aca3-39d83b56f414", "name": "network-vif-plugged", "status": "completed", "tag": "ce99a25f-dfdb-4798-8830-d2f4a66e6cc8"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:26:59 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-d46a35a2-2a47-4ecf-8bb0-2fd401272ffd req-8f21a29b-2808-4c88-85b3-b7bdcfee8154 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:59 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-d46a35a2-2a47-4ecf-8bb0-2fd401272ffd req-8f21a29b-2808-4c88-85b3-b7bdcfee8154 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:59 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-d46a35a2-2a47-4ecf-8bb0-2fd401272ffd req-8f21a29b-2808-4c88-85b3-b7bdcfee8154 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:59 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-d46a35a2-2a47-4ecf-8bb0-2fd401272ffd req-8f21a29b-2808-4c88-85b3-b7bdcfee8154 service nova] Creating event network-vif-plugged:ce99a25f-dfdb-4798-8830-d2f4a66e6cc8 for instance f846ecc9-ecc4-4e8f-aca3-39d83b56f414 on user Apr 11 15:26:59 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-d46a35a2-2a47-4ecf-8bb0-2fd401272ffd req-8f21a29b-2808-4c88-85b3-b7bdcfee8154 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052426 Apr 11 15:26:59 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 105/312] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:26:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:26:59 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f3a06747-0f43-4731-87e6-40629c382a6b" status: 204 len: 0 microversion: 2.1 time: 0.143303 Apr 11 15:26:59 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 105/313] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:26:59 2023] DELETE /compute/v2.1/servers/f3a06747-0f43-4731-87e6-40629c382a6b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:26:59 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-46c6833c-f21e-4e4c-89ef-a3131f37db65 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:26:59 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-46c6833c-f21e-4e4c-89ef-a3131f37db65 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:26:59 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-46c6833c-f21e-4e4c-89ef-a3131f37db65 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:59 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-46c6833c-f21e-4e4c-89ef-a3131f37db65 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:59 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-46c6833c-f21e-4e4c-89ef-a3131f37db65 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:26:59 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-46c6833c-f21e-4e4c-89ef-a3131f37db65 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:26:59 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-46c6833c-f21e-4e4c-89ef-a3131f37db65 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:26:59 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-46c6833c-f21e-4e4c-89ef-a3131f37db65 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:00 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-46c6833c-f21e-4e4c-89ef-a3131f37db65 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2717e456dcc941899c48c3c973083bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da140971126a4d298ff718275e7a22ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:27:00 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-46c6833c-f21e-4e4c-89ef-a3131f37db65 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3a06747-0f43-4731-87e6-40629c382a6b" status: 200 len: 1669 microversion: 2.1 time: 0.171976 Apr 11 15:27:00 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 104/314] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:26:59 2023] GET /compute/v2.1/servers/f3a06747-0f43-4731-87e6-40629c382a6b => generated 1669 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:27:01 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-9f6a42c6-08a5-45f9-815a-82319c04ea97 req-974fb18d-d93f-4ed6-ac44-a0c4601f2a21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f846ecc9-ecc4-4e8f-aca3-39d83b56f414", "name": "network-vif-plugged", "status": "completed", "tag": "ce99a25f-dfdb-4798-8830-d2f4a66e6cc8"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:27:01 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-9f6a42c6-08a5-45f9-815a-82319c04ea97 req-974fb18d-d93f-4ed6-ac44-a0c4601f2a21 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:01 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-9f6a42c6-08a5-45f9-815a-82319c04ea97 req-974fb18d-d93f-4ed6-ac44-a0c4601f2a21 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:01 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-9f6a42c6-08a5-45f9-815a-82319c04ea97 req-974fb18d-d93f-4ed6-ac44-a0c4601f2a21 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:01 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-9f6a42c6-08a5-45f9-815a-82319c04ea97 req-974fb18d-d93f-4ed6-ac44-a0c4601f2a21 service nova] Creating event network-vif-plugged:ce99a25f-dfdb-4798-8830-d2f4a66e6cc8 for instance f846ecc9-ecc4-4e8f-aca3-39d83b56f414 on user Apr 11 15:27:01 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-9f6a42c6-08a5-45f9-815a-82319c04ea97 req-974fb18d-d93f-4ed6-ac44-a0c4601f2a21 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031880 Apr 11 15:27:01 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 106/315] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:27:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:27:02 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-4ef27147-0a57-4044-8446-339f1f1f3337 req-8bcb4781-3a8d-49fb-b628-ebe51ac4f0f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3a06747-0f43-4731-87e6-40629c382a6b", "name": "network-vif-unplugged", "status": "completed", "tag": "a7049f98-5ea1-4167-be7f-3206830f17c4"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:27:03 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-4ef27147-0a57-4044-8446-339f1f1f3337 req-8bcb4781-3a8d-49fb-b628-ebe51ac4f0f8 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:03 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-4ef27147-0a57-4044-8446-339f1f1f3337 req-8bcb4781-3a8d-49fb-b628-ebe51ac4f0f8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:03 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-4ef27147-0a57-4044-8446-339f1f1f3337 req-8bcb4781-3a8d-49fb-b628-ebe51ac4f0f8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:03 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-4ef27147-0a57-4044-8446-339f1f1f3337 req-8bcb4781-3a8d-49fb-b628-ebe51ac4f0f8 service nova] Creating event network-vif-unplugged:a7049f98-5ea1-4167-be7f-3206830f17c4 for instance f3a06747-0f43-4731-87e6-40629c382a6b on user Apr 11 15:27:03 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-4ef27147-0a57-4044-8446-339f1f1f3337 req-8bcb4781-3a8d-49fb-b628-ebe51ac4f0f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038453 Apr 11 15:27:03 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 106/316] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:27:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:27:05 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-dcf91874-f222-42a6-a709-4b756bfe60d0 req-dc730c59-81a7-4c8f-9369-76d58f968618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3a06747-0f43-4731-87e6-40629c382a6b", "name": "network-vif-plugged", "status": "completed", "tag": "a7049f98-5ea1-4167-be7f-3206830f17c4"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:27:05 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:27:05 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:27:05 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:27:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-dcf91874-f222-42a6-a709-4b756bfe60d0 req-dc730c59-81a7-4c8f-9369-76d58f968618 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-dcf91874-f222-42a6-a709-4b756bfe60d0 req-dc730c59-81a7-4c8f-9369-76d58f968618 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-dcf91874-f222-42a6-a709-4b756bfe60d0 req-dc730c59-81a7-4c8f-9369-76d58f968618 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:05 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=29 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:27:05 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-dcf91874-f222-42a6-a709-4b756bfe60d0 req-dc730c59-81a7-4c8f-9369-76d58f968618 service nova] Creating event network-vif-plugged:a7049f98-5ea1-4167-be7f-3206830f17c4 for instance f3a06747-0f43-4731-87e6-40629c382a6b on user Apr 11 15:27:05 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-dcf91874-f222-42a6-a709-4b756bfe60d0 req-dc730c59-81a7-4c8f-9369-76d58f968618 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065027 Apr 11 15:27:05 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 105/317] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:27:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:27:07 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-177dbbdb-227f-419b-ac4f-233706f94d3c req-2c0eb452-3ff3-461e-b415-3bd0cdd5017b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3a06747-0f43-4731-87e6-40629c382a6b", "name": "network-vif-deleted", "tag": "a7049f98-5ea1-4167-be7f-3206830f17c4"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:27:07 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=21 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:27:07 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-177dbbdb-227f-419b-ac4f-233706f94d3c req-2c0eb452-3ff3-461e-b415-3bd0cdd5017b service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:07 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-177dbbdb-227f-419b-ac4f-233706f94d3c req-2c0eb452-3ff3-461e-b415-3bd0cdd5017b service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:07 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-177dbbdb-227f-419b-ac4f-233706f94d3c req-2c0eb452-3ff3-461e-b415-3bd0cdd5017b service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:07 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=29 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:27:07 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-177dbbdb-227f-419b-ac4f-233706f94d3c req-2c0eb452-3ff3-461e-b415-3bd0cdd5017b service nova] Creating event network-vif-deleted:a7049f98-5ea1-4167-be7f-3206830f17c4 for instance f3a06747-0f43-4731-87e6-40629c382a6b on user Apr 11 15:27:07 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-177dbbdb-227f-419b-ac4f-233706f94d3c req-2c0eb452-3ff3-461e-b415-3bd0cdd5017b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046774 Apr 11 15:27:07 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 107/318] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:27:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:27:24 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:27:24 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:27:24 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:27:24 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-7e10b058-e50e-4fd9-9b71-6a2f20d5958d tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:27:24 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-7e10b058-e50e-4fd9-9b71-6a2f20d5958d tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:27:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7e10b058-e50e-4fd9-9b71-6a2f20d5958d tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7e10b058-e50e-4fd9-9b71-6a2f20d5958d tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7e10b058-e50e-4fd9-9b71-6a2f20d5958d tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7e10b058-e50e-4fd9-9b71-6a2f20d5958d tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7e10b058-e50e-4fd9-9b71-6a2f20d5958d tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7e10b058-e50e-4fd9-9b71-6a2f20d5958d tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:24 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-7e10b058-e50e-4fd9-9b71-6a2f20d5958d tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e1716b2bb2438b93d46dc8052c788b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ed867a40534b70bf75dc0cc28fdfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:27:24 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-7e10b058-e50e-4fd9-9b71-6a2f20d5958d tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39e3dfb1-bc09-474d-b8cb-f01b11923eae" status: 200 len: 1501 microversion: 2.1 time: 0.165472 Apr 11 15:27:24 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 107/319] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:27:24 2023] GET /compute/v2.1/servers/39e3dfb1-bc09-474d-b8cb-f01b11923eae => generated 1501 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:27:29 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:27:29 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:27:29 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-77f08c24-8379-4c46-b6d1-4b8da7f374a7 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:27:29 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-77f08c24-8379-4c46-b6d1-4b8da7f374a7 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:27:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-77f08c24-8379-4c46-b6d1-4b8da7f374a7 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-77f08c24-8379-4c46-b6d1-4b8da7f374a7 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-77f08c24-8379-4c46-b6d1-4b8da7f374a7 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-77f08c24-8379-4c46-b6d1-4b8da7f374a7 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-77f08c24-8379-4c46-b6d1-4b8da7f374a7 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-77f08c24-8379-4c46-b6d1-4b8da7f374a7 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:29 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-77f08c24-8379-4c46-b6d1-4b8da7f374a7 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c7f9af6776413c91e2638712a142f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c879d28040aba0ebc76bc2a80693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:27:29 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-77f08c24-8379-4c46-b6d1-4b8da7f374a7 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5" status: 200 len: 1484 microversion: 2.1 time: 0.160300 Apr 11 15:27:29 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 106/320] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:27:29 2023] GET /compute/v2.1/servers/fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5 => generated 1484 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:27:36 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:27:36 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:27:36 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-2391bf0a-1152-4fad-a77b-001551cc0948 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:27:36 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-2391bf0a-1152-4fad-a77b-001551cc0948 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:27:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2391bf0a-1152-4fad-a77b-001551cc0948 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2391bf0a-1152-4fad-a77b-001551cc0948 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2391bf0a-1152-4fad-a77b-001551cc0948 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2391bf0a-1152-4fad-a77b-001551cc0948 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2391bf0a-1152-4fad-a77b-001551cc0948 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2391bf0a-1152-4fad-a77b-001551cc0948 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:36 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-2391bf0a-1152-4fad-a77b-001551cc0948 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b0d90fd2-6a95-43c4-8756-e82071d99154/action" status: 202 len: 0 microversion: 2.87 time: 0.080315 Apr 11 15:27:36 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 108/321] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 15:27:36 2023] POST /compute/v2.1/servers/b0d90fd2-6a95-43c4-8756-e82071d99154/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 11 15:27:36 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:27:36 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:27:36 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-fdcecb43-e42d-4a13-a4b9-cdf7064cdca8 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:27:36 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-fdcecb43-e42d-4a13-a4b9-cdf7064cdca8 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:27:36 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-fdcecb43-e42d-4a13-a4b9-cdf7064cdca8 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:36 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-fdcecb43-e42d-4a13-a4b9-cdf7064cdca8 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:36 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-fdcecb43-e42d-4a13-a4b9-cdf7064cdca8 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:36 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-fdcecb43-e42d-4a13-a4b9-cdf7064cdca8 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:36 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-fdcecb43-e42d-4a13-a4b9-cdf7064cdca8 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:36 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-fdcecb43-e42d-4a13-a4b9-cdf7064cdca8 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:36 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-fdcecb43-e42d-4a13-a4b9-cdf7064cdca8 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:27:36 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-fdcecb43-e42d-4a13-a4b9-cdf7064cdca8 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:27:36 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-fdcecb43-e42d-4a13-a4b9-cdf7064cdca8 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:27:36 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-fdcecb43-e42d-4a13-a4b9-cdf7064cdca8 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0d90fd2-6a95-43c4-8756-e82071d99154" status: 200 len: 1762 microversion: 2.87 time: 0.165907 Apr 11 15:27:36 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 108/322] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:27:36 2023] GET /compute/v2.1/servers/b0d90fd2-6a95-43c4-8756-e82071d99154 => generated 1762 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:27:37 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-f496724a-323a-4dae-b241-0bee4856fc84 req-5a0daadd-8636-4a72-9036-e9ad3aee90ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d90fd2-6a95-43c4-8756-e82071d99154", "name": "network-vif-unplugged", "status": "completed", "tag": "4718fa68-0eb9-4592-8c43-981438e3d0b8"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:27:37 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-f496724a-323a-4dae-b241-0bee4856fc84 req-5a0daadd-8636-4a72-9036-e9ad3aee90ef service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:37 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-f496724a-323a-4dae-b241-0bee4856fc84 req-5a0daadd-8636-4a72-9036-e9ad3aee90ef service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:37 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-f496724a-323a-4dae-b241-0bee4856fc84 req-5a0daadd-8636-4a72-9036-e9ad3aee90ef service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:37 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-f496724a-323a-4dae-b241-0bee4856fc84 req-5a0daadd-8636-4a72-9036-e9ad3aee90ef service nova] Creating event network-vif-unplugged:4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance b0d90fd2-6a95-43c4-8756-e82071d99154 on user Apr 11 15:27:37 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-f496724a-323a-4dae-b241-0bee4856fc84 req-5a0daadd-8636-4a72-9036-e9ad3aee90ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034726 Apr 11 15:27:37 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 107/323] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:27:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:27:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d90fd2-6a95-43c4-8756-e82071d99154", "name": "network-vif-plugged", "status": "completed", "tag": "4718fa68-0eb9-4592-8c43-981438e3d0b8"}, {"server_uuid": "b0d90fd2-6a95-43c4-8756-e82071d99154", "name": "network-vif-plugged", "status": "completed", "tag": "4718fa68-0eb9-4592-8c43-981438e3d0b8"}, {"server_uuid": "b0d90fd2-6a95-43c4-8756-e82071d99154", "name": "network-vif-plugged", "status": "completed", "tag": "4718fa68-0eb9-4592-8c43-981438e3d0b8"}, {"server_uuid": "b0d90fd2-6a95-43c4-8756-e82071d99154", "name": "network-vif-unplugged", "status": "completed", "tag": "4718fa68-0eb9-4592-8c43-981438e3d0b8"}, {"server_uuid": "b0d90fd2-6a95-43c4-8756-e82071d99154", "name": "network-vif-plugged", "status": "completed", "tag": "4718fa68-0eb9-4592-8c43-981438e3d0b8"}, {"server_uuid": "b0d90fd2-6a95-43c4-8756-e82071d99154", "name": "network-vif-plugged", "status": "completed", "tag": "4718fa68-0eb9-4592-8c43-981438e3d0b8"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:27:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:40 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] Creating event network-vif-plugged:4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance b0d90fd2-6a95-43c4-8756-e82071d99154 on user Apr 11 15:27:40 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] Creating event network-vif-plugged:4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance b0d90fd2-6a95-43c4-8756-e82071d99154 on user Apr 11 15:27:40 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] Creating event network-vif-plugged:4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance b0d90fd2-6a95-43c4-8756-e82071d99154 on user Apr 11 15:27:40 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] Creating event network-vif-unplugged:4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance b0d90fd2-6a95-43c4-8756-e82071d99154 on user Apr 11 15:27:40 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] Creating event network-vif-plugged:4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance b0d90fd2-6a95-43c4-8756-e82071d99154 on user Apr 11 15:27:40 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] Creating event network-vif-plugged:4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance b0d90fd2-6a95-43c4-8756-e82071d99154 on user Apr 11 15:27:40 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.031023 Apr 11 15:27:40 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 109/324] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:27:39 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:27:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-31c415f4-1bc9-4b9f-b8a2-23806907dfbe tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Action: 'create', calling method: .version_select at 0x7f4c2ef2d090>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-465777949", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsY8FMpTDo2iDL8D2048rjTj/VI+ylGYuKoz69HdKNUW8YbpOt3axid+tNJOYBWww9OiD0Ac5LQl/2OtP+ihiza/khI/3Fa6GADgrvtJLGlEyRQIArtEl+HOseWnLoJKA=="}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:27:40 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-31c415f4-1bc9-4b9f-b8a2-23806907dfbe tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Getting quotas for project 90bfd48094c54cd5b13dabf27ebdd5dd. Resources: {'key_pairs'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:27:40 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-31c415f4-1bc9-4b9f-b8a2-23806907dfbe tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Getting quotas for user 091ece3baa634583a7cc3000c78f2c26 and project 90bfd48094c54cd5b13dabf27ebdd5dd. Resources: {'key_pairs'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:27:40 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-31c415f4-1bc9-4b9f-b8a2-23806907dfbe tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.250130 Apr 11 15:27:40 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 109/325] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 15:27:40 2023] POST /compute/v2.1/os-keypairs => generated 404 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:27:41 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-b2fa0f80-9425-4b2d-b43f-91b0d422c075 req-159dc598-a0da-487c-87fd-9c36d1781a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d90fd2-6a95-43c4-8756-e82071d99154", "name": "network-vif-plugged", "status": "completed", "tag": "4718fa68-0eb9-4592-8c43-981438e3d0b8"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:27:41 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-b2fa0f80-9425-4b2d-b43f-91b0d422c075 req-159dc598-a0da-487c-87fd-9c36d1781a8c service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:41 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-b2fa0f80-9425-4b2d-b43f-91b0d422c075 req-159dc598-a0da-487c-87fd-9c36d1781a8c service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:41 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-b2fa0f80-9425-4b2d-b43f-91b0d422c075 req-159dc598-a0da-487c-87fd-9c36d1781a8c service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:41 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-b2fa0f80-9425-4b2d-b43f-91b0d422c075 req-159dc598-a0da-487c-87fd-9c36d1781a8c service nova] Creating event network-vif-plugged:4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance b0d90fd2-6a95-43c4-8756-e82071d99154 on user Apr 11 15:27:41 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-b2fa0f80-9425-4b2d-b43f-91b0d422c075 req-159dc598-a0da-487c-87fd-9c36d1781a8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030085 Apr 11 15:27:41 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 108/326] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:27:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:27:41 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1036280409", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-465777949", "security_groups": [{"name": "tempest-secgroup-smoke-416840079"}], "networks": [{"uuid": "fc99abc0-f7ce-488e-b3d5-926973bb5e6b"}]}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:27:42 user devstack@n-api.service[61167]: DEBUG nova.network.neutron [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] validate_networks() for [('fc99abc0-f7ce-488e-b3d5-926973bb5e6b', None, None, None, None, None)] {{(pid=61167) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:27:42 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Flavor limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:27:42 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Image limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:27:42 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Flavor pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:27:42 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Image pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:27:42 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:27:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:42 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Getting quotas for project 90bfd48094c54cd5b13dabf27ebdd5dd. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:27:42 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Getting quotas for user 091ece3baa634583a7cc3000c78f2c26 and project 90bfd48094c54cd5b13dabf27ebdd5dd. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:27:42 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Going to run 1 instances... {{(pid=61167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:27:42 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52fe638c-5ada-47d5-b376-233bfa808a37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:27:42 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.621222 Apr 11 15:27:42 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 110/327] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 15:27:41 2023] POST /compute/v2.1/servers => generated 403 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 15:27:42 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-af45c6d3-12e3-4045-a6e3-1738a3736543 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:27:42 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-af45c6d3-12e3-4045-a6e3-1738a3736543 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:27:42 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-af45c6d3-12e3-4045-a6e3-1738a3736543 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ece3baa634583a7cc3000c78f2c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bfd48094c54cd5b13dabf27ebdd5dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:27:42 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-af45c6d3-12e3-4045-a6e3-1738a3736543 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896" status: 200 len: 1256 microversion: 2.1 time: 0.066968 Apr 11 15:27:42 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 110/328] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:27:42 2023] GET /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896 => generated 1256 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:27:43 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-e1927989-e622-4a1c-993c-570b743ede7a tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:27:43 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-e1927989-e622-4a1c-993c-570b743ede7a tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:27:43 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e1927989-e622-4a1c-993c-570b743ede7a tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:43 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e1927989-e622-4a1c-993c-570b743ede7a tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:43 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e1927989-e622-4a1c-993c-570b743ede7a tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:43 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e1927989-e622-4a1c-993c-570b743ede7a tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:43 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e1927989-e622-4a1c-993c-570b743ede7a tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:43 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e1927989-e622-4a1c-993c-570b743ede7a tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:43 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-e1927989-e622-4a1c-993c-570b743ede7a tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2538af5c739404aa433b766976e5b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561130d089c8415297697bcedc93aefc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:27:43 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-e1927989-e622-4a1c-993c-570b743ede7a tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f846ecc9-ecc4-4e8f-aca3-39d83b56f414" status: 200 len: 1493 microversion: 2.1 time: 0.143575 Apr 11 15:27:43 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 109/329] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:27:43 2023] GET /compute/v2.1/servers/f846ecc9-ecc4-4e8f-aca3-39d83b56f414 => generated 1493 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:27:44 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-447d0aa0-c076-4440-9361-91dc2558df64 req-9c8094f8-095c-47b2-9aad-7b2f5a07b756 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d534d17d-ba77-4447-8a63-7d6021ad7896", "tag": "05f23fee-4450-48d6-8b2f-6c1fcf308da6"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:27:44 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-447d0aa0-c076-4440-9361-91dc2558df64 req-9c8094f8-095c-47b2-9aad-7b2f5a07b756 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:44 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-447d0aa0-c076-4440-9361-91dc2558df64 req-9c8094f8-095c-47b2-9aad-7b2f5a07b756 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:44 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-447d0aa0-c076-4440-9361-91dc2558df64 req-9c8094f8-095c-47b2-9aad-7b2f5a07b756 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:44 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-447d0aa0-c076-4440-9361-91dc2558df64 req-9c8094f8-095c-47b2-9aad-7b2f5a07b756 service nova] Creating event network-changed:05f23fee-4450-48d6-8b2f-6c1fcf308da6 for instance d534d17d-ba77-4447-8a63-7d6021ad7896 on user Apr 11 15:27:44 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-447d0aa0-c076-4440-9361-91dc2558df64 req-9c8094f8-095c-47b2-9aad-7b2f5a07b756 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028850 Apr 11 15:27:44 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 111/330] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:27:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:27:46 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-b134487a-78b4-42d9-b920-1c19ed602ce7 req-ceab7a0a-b2d1-403b-839f-e28485c0eb11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d534d17d-ba77-4447-8a63-7d6021ad7896", "name": "network-vif-plugged", "status": "completed", "tag": "05f23fee-4450-48d6-8b2f-6c1fcf308da6"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:27:46 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:27:46 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-b134487a-78b4-42d9-b920-1c19ed602ce7 req-ceab7a0a-b2d1-403b-839f-e28485c0eb11 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:46 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-b134487a-78b4-42d9-b920-1c19ed602ce7 req-ceab7a0a-b2d1-403b-839f-e28485c0eb11 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:46 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-b134487a-78b4-42d9-b920-1c19ed602ce7 req-ceab7a0a-b2d1-403b-839f-e28485c0eb11 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:46 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-b134487a-78b4-42d9-b920-1c19ed602ce7 req-ceab7a0a-b2d1-403b-839f-e28485c0eb11 service nova] Creating event network-vif-plugged:05f23fee-4450-48d6-8b2f-6c1fcf308da6 for instance d534d17d-ba77-4447-8a63-7d6021ad7896 on user Apr 11 15:27:46 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-b134487a-78b4-42d9-b920-1c19ed602ce7 req-ceab7a0a-b2d1-403b-839f-e28485c0eb11 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036639 Apr 11 15:27:46 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 111/331] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:27:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:27:47 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-60fbcfc6-8b85-4b2b-b9ee-9692d9e4e7ef tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "092c1963-af41-4f6f-9205-8970fc6e3122"}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:27:47 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-60fbcfc6-8b85-4b2b-b9ee-9692d9e4e7ef tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:27:47 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-60fbcfc6-8b85-4b2b-b9ee-9692d9e4e7ef tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:47 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-60fbcfc6-8b85-4b2b-b9ee-9692d9e4e7ef tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:47 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-60fbcfc6-8b85-4b2b-b9ee-9692d9e4e7ef tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:47 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-60fbcfc6-8b85-4b2b-b9ee-9692d9e4e7ef tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:47 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-60fbcfc6-8b85-4b2b-b9ee-9692d9e4e7ef tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:47 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-60fbcfc6-8b85-4b2b-b9ee-9692d9e4e7ef tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:48 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-60fbcfc6-8b85-4b2b-b9ee-9692d9e4e7ef tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.284528 Apr 11 15:27:48 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 110/332] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Apr 11 15:27:47 2023] POST /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/os-volume_attachments => generated 188 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 15:27:48 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:27:48 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:27:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:48 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61167) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 11 15:27:48 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/action" status: 202 len: 0 microversion: 2.20 time: 0.109773 Apr 11 15:27:48 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 112/333] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 15:27:48 2023] POST /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:27:48 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-126c6188-0a71-4ae8-a3f6-e7e4ef605166 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:27:48 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-126c6188-0a71-4ae8-a3f6-e7e4ef605166 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:27:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-126c6188-0a71-4ae8-a3f6-e7e4ef605166 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-126c6188-0a71-4ae8-a3f6-e7e4ef605166 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-126c6188-0a71-4ae8-a3f6-e7e4ef605166 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-126c6188-0a71-4ae8-a3f6-e7e4ef605166 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-126c6188-0a71-4ae8-a3f6-e7e4ef605166 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-126c6188-0a71-4ae8-a3f6-e7e4ef605166 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:48 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-126c6188-0a71-4ae8-a3f6-e7e4ef605166 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:27:48 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-126c6188-0a71-4ae8-a3f6-e7e4ef605166 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:27:48 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-126c6188-0a71-4ae8-a3f6-e7e4ef605166 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:27:48 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-126c6188-0a71-4ae8-a3f6-e7e4ef605166 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" status: 200 len: 1739 microversion: 2.20 time: 0.142772 Apr 11 15:27:48 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 112/334] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:27:48 2023] GET /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d => generated 1739 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:27:48 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-ed69dc9e-56db-42b4-8610-2ad42e38c045 req-861de9bb-740c-4333-90a3-73b2329b2051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d534d17d-ba77-4447-8a63-7d6021ad7896", "name": "network-vif-plugged", "status": "completed", "tag": "05f23fee-4450-48d6-8b2f-6c1fcf308da6"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:27:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-ed69dc9e-56db-42b4-8610-2ad42e38c045 req-861de9bb-740c-4333-90a3-73b2329b2051 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-ed69dc9e-56db-42b4-8610-2ad42e38c045 req-861de9bb-740c-4333-90a3-73b2329b2051 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-ed69dc9e-56db-42b4-8610-2ad42e38c045 req-861de9bb-740c-4333-90a3-73b2329b2051 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:48 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-ed69dc9e-56db-42b4-8610-2ad42e38c045 req-861de9bb-740c-4333-90a3-73b2329b2051 service nova] Creating event network-vif-plugged:05f23fee-4450-48d6-8b2f-6c1fcf308da6 for instance d534d17d-ba77-4447-8a63-7d6021ad7896 on user Apr 11 15:27:48 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-ed69dc9e-56db-42b4-8610-2ad42e38c045 req-861de9bb-740c-4333-90a3-73b2329b2051 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027016 Apr 11 15:27:48 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 111/335] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:27:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:27:49 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:27:49 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:27:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:49 user devstack@n-api.service[61167]: DEBUG nova.objects.instance [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'services' on Instance uuid 6a805345-374c-4326-9e8f-39bfc7947a35 {{(pid=61167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 15:27:49 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35/os-volume_attachments/cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4" status: 202 len: 0 microversion: 2.1 time: 0.177096 Apr 11 15:27:49 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 113/336] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 15:27:49 2023] DELETE /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35/os-volume_attachments/cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:27:49 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-f32be8f3-cd3e-40d8-9c03-8e1ec0616707 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:27:49 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-f32be8f3-cd3e-40d8-9c03-8e1ec0616707 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:27:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-f32be8f3-cd3e-40d8-9c03-8e1ec0616707 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-f32be8f3-cd3e-40d8-9c03-8e1ec0616707 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-f32be8f3-cd3e-40d8-9c03-8e1ec0616707 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-f32be8f3-cd3e-40d8-9c03-8e1ec0616707 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-f32be8f3-cd3e-40d8-9c03-8e1ec0616707 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-f32be8f3-cd3e-40d8-9c03-8e1ec0616707 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:49 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-f32be8f3-cd3e-40d8-9c03-8e1ec0616707 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054312 Apr 11 15:27:49 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 113/337] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:27:49 2023] GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:27:50 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-32365fbb-7c4a-47b8-8301-4157a877d7ac tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:27:50 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-32365fbb-7c4a-47b8-8301-4157a877d7ac tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:27:50 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-32365fbb-7c4a-47b8-8301-4157a877d7ac tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:50 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-32365fbb-7c4a-47b8-8301-4157a877d7ac tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:50 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-32365fbb-7c4a-47b8-8301-4157a877d7ac tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:50 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-32365fbb-7c4a-47b8-8301-4157a877d7ac tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:50 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-32365fbb-7c4a-47b8-8301-4157a877d7ac tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:50 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-32365fbb-7c4a-47b8-8301-4157a877d7ac tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:50 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-32365fbb-7c4a-47b8-8301-4157a877d7ac tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] HTTP exception thrown: Instance f3a06747-0f43-4731-87e6-40629c382a6b could not be found. Apr 11 15:27:50 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-32365fbb-7c4a-47b8-8301-4157a877d7ac tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Request method failure captured: Apr 11 15:27:50 user devstack@n-api.service[61166]: request: GET /compute/v2.1/servers/f3a06747-0f43-4731-87e6-40629c382a6b HTTP/1.1 Apr 11 15:27:50 user devstack@n-api.service[61166]: Accept: application/json Apr 11 15:27:50 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 15:27:50 user devstack@n-api.service[61166]: Connection: close Apr 11 15:27:50 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 15:27:50 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 15:27:50 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 15:27:50 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 15:27:50 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 15:27:50 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNXrT8SpyxJL1DGpzBjmmuzZjpqrAIuOto9ecrwnpeJEzp_iHzsoc2OCJVt8uKcjAXGMxk0pRgJoG21wHVXlfVVC7KN6GVhKTaa0z-GBISHZqMBfUOTr3S0jjiQdJBTyK9NRah0CixnNWPRessogyZfRqBUAYYEoJVGmAzrTu0TL8ktI Apr 11 15:27:50 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 15:27:50 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 15:27:50 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 15:27:50 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 15:27:50 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 15:27:50 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 15:27:50 user devstack@n-api.service[61166]: X-Project-Id: da140971126a4d298ff718275e7a22ec Apr 11 15:27:50 user devstack@n-api.service[61166]: X-Project-Name: tempest-VolumesAdminNegativeTest-2033224639 Apr 11 15:27:50 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 15:27:50 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 15:27:50 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/da140971126a4d298ff718275e7a22ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/da140971126a4d298ff718275e7a22ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/da140971126a4d298ff718275e7a22ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:27:50 user devstack@n-api.service[61166]: X-Tenant: tempest-VolumesAdminNegativeTest-2033224639 Apr 11 15:27:50 user devstack@n-api.service[61166]: X-Tenant-Id: da140971126a4d298ff718275e7a22ec Apr 11 15:27:50 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2033224639 Apr 11 15:27:50 user devstack@n-api.service[61166]: X-User: tempest-VolumesAdminNegativeTest-2033224639-project-member Apr 11 15:27:50 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 15:27:50 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 15:27:50 user devstack@n-api.service[61166]: X-User-Id: 2717e456dcc941899c48c3c973083bd4 Apr 11 15:27:50 user devstack@n-api.service[61166]: X-User-Name: tempest-VolumesAdminNegativeTest-2033224639-project-member Apr 11 15:27:50 user devstack@n-api.service[61166]: method: > Apr 11 15:27:50 user devstack@n-api.service[61166]: exception: Instance f3a06747-0f43-4731-87e6-40629c382a6b could not be found. Apr 11 15:27:50 user devstack@n-api.service[61166]: action_args: {'id': 'f3a06747-0f43-4731-87e6-40629c382a6b'} Apr 11 15:27:50 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3a06747-0f43-4731-87e6-40629c382a6b could not be found. Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3a06747-0f43-4731-87e6-40629c382a6b could not be found. Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3a06747-0f43-4731-87e6-40629c382a6b could not be found. Apr 11 15:27:50 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:27:50 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-32365fbb-7c4a-47b8-8301-4157a877d7ac tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Returning 404 to user: Instance f3a06747-0f43-4731-87e6-40629c382a6b could not be found. {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:27:50 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-32365fbb-7c4a-47b8-8301-4157a877d7ac tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3a06747-0f43-4731-87e6-40629c382a6b" status: 404 len: 111 microversion: 2.1 time: 0.030493 Apr 11 15:27:50 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 112/338] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:27:50 2023] GET /compute/v2.1/servers/f3a06747-0f43-4731-87e6-40629c382a6b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:27:50 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-c2f5f989-7e5e-4810-98e3-2c7ec4f98c37 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Calling method '.version_select at 0x7f4c2efaf520>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:27:50 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-c2f5f989-7e5e-4810-98e3-2c7ec4f98c37 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1249294022" status: 202 len: 0 microversion: 2.1 time: 0.021612 Apr 11 15:27:50 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 114/339] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 15:27:50 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1249294022 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:27:55 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-e7e56143-e7d1-4cd6-ad28-6da7d8ff208e req-f129fd9e-3eb3-4977-8547-0cbc0a848dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d", "tag": "1ad8234a-3f96-43a0-9dea-862e6efcda73"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:27:55 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:27:55 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-e7e56143-e7d1-4cd6-ad28-6da7d8ff208e req-f129fd9e-3eb3-4977-8547-0cbc0a848dd8 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:27:55 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-e7e56143-e7d1-4cd6-ad28-6da7d8ff208e req-f129fd9e-3eb3-4977-8547-0cbc0a848dd8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:27:55 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-e7e56143-e7d1-4cd6-ad28-6da7d8ff208e req-f129fd9e-3eb3-4977-8547-0cbc0a848dd8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:27:55 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-e7e56143-e7d1-4cd6-ad28-6da7d8ff208e req-f129fd9e-3eb3-4977-8547-0cbc0a848dd8 service nova] Creating event network-changed:1ad8234a-3f96-43a0-9dea-862e6efcda73 for instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d on user Apr 11 15:27:55 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-e7e56143-e7d1-4cd6-ad28-6da7d8ff208e req-f129fd9e-3eb3-4977-8547-0cbc0a848dd8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041566 Apr 11 15:27:55 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 114/340] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:27:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:28:03 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-c143660d-00ce-42a8-915b-a3138ba5b3d7 req-fca08ed2-3751-4087-8a3e-28a0e62facbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d", "name": "network-vif-plugged", "status": "completed", "tag": "1ad8234a-3f96-43a0-9dea-862e6efcda73"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:28:04 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=14 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:28:04 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:28:04 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-c143660d-00ce-42a8-915b-a3138ba5b3d7 req-fca08ed2-3751-4087-8a3e-28a0e62facbe service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:04 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-c143660d-00ce-42a8-915b-a3138ba5b3d7 req-fca08ed2-3751-4087-8a3e-28a0e62facbe service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:04 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-c143660d-00ce-42a8-915b-a3138ba5b3d7 req-fca08ed2-3751-4087-8a3e-28a0e62facbe service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:04 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-c143660d-00ce-42a8-915b-a3138ba5b3d7 req-fca08ed2-3751-4087-8a3e-28a0e62facbe service nova] Creating event network-vif-plugged:1ad8234a-3f96-43a0-9dea-862e6efcda73 for instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d on user Apr 11 15:28:04 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-c143660d-00ce-42a8-915b-a3138ba5b3d7 req-fca08ed2-3751-4087-8a3e-28a0e62facbe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062392 Apr 11 15:28:04 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 113/341] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:28:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:28:06 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:28:06 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:28:06 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:28:06 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:28:06 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-cdf37cb8-e3be-4c2b-b08f-25e6a3beb03f req-cc84ace5-837d-482c-8066-7916fd7cffbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d", "name": "network-vif-plugged", "status": "completed", "tag": "1ad8234a-3f96-43a0-9dea-862e6efcda73"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:28:06 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-cdf37cb8-e3be-4c2b-b08f-25e6a3beb03f req-cc84ace5-837d-482c-8066-7916fd7cffbf service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:06 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-cdf37cb8-e3be-4c2b-b08f-25e6a3beb03f req-cc84ace5-837d-482c-8066-7916fd7cffbf service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:06 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-cdf37cb8-e3be-4c2b-b08f-25e6a3beb03f req-cc84ace5-837d-482c-8066-7916fd7cffbf service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:06 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-cdf37cb8-e3be-4c2b-b08f-25e6a3beb03f req-cc84ace5-837d-482c-8066-7916fd7cffbf service nova] Creating event network-vif-plugged:1ad8234a-3f96-43a0-9dea-862e6efcda73 for instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d on user Apr 11 15:28:06 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-cdf37cb8-e3be-4c2b-b08f-25e6a3beb03f req-cc84ace5-837d-482c-8066-7916fd7cffbf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039647 Apr 11 15:28:06 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 115/342] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:28:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:28:15 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-76074a17-14ba-4606-9371-1842cd7f797e tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Action: 'create', calling method: .version_select at 0x7f4c2ef2c790>, body: {"keypair": {"name": "tempest-keypair-1011126544", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQhnP1Gx1ErLuuEevJpV94XRpvcJAoAfxD6RZqXP7Kvn0H8XePF/x7sWzG5H5vtetd0gs+rS/bMxjK4Qz9b0uYhYgbQvD0DmjSlBMXC1CeKAiMrjjZNT7Keb43XJ65W+w=="}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:28:15 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:28:15 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=16 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:28:15 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-76074a17-14ba-4606-9371-1842cd7f797e tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Getting quotas for project 82dec4b679f24d1e85b1105b4849cddd. Resources: {'key_pairs'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:28:15 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-76074a17-14ba-4606-9371-1842cd7f797e tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Getting quotas for user f32986358bcc4148ad3f361e3944ed81 and project 82dec4b679f24d1e85b1105b4849cddd. Resources: {'key_pairs'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:28:15 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-76074a17-14ba-4606-9371-1842cd7f797e tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.49 time: 0.064690 Apr 11 15:28:15 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 115/343] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 15:28:15 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 66 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 15:28:17 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-982441201", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "921b7e62-65aa-426c-9286-8b31b88588a8"}], "security_groups": [{"name": "tempest-securitygroup--784271925"}], "key_name": "tempest-keypair-1011126544", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:28:17 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:28:17 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:28:17 user devstack@n-api.service[61166]: DEBUG nova.network.neutron [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] validate_networks() for [('921b7e62-65aa-426c-9286-8b31b88588a8', None, None, None, None, None)] {{(pid=61166) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:28:17 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Flavor limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:28:17 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Image limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:28:17 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Flavor pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:28:17 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Image pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:28:17 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:28:17 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:17 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:17 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:17 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:17 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:17 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:17 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Getting quotas for project 82dec4b679f24d1e85b1105b4849cddd. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:28:17 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Getting quotas for user f32986358bcc4148ad3f361e3944ed81 and project 82dec4b679f24d1e85b1105b4849cddd. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:28:17 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Going to run 1 instances... {{(pid=61166) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:28:17 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52fe638c-5ada-47d5-b376-233bfa808a37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:28:17 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.49 time: 0.567042 Apr 11 15:28:17 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 114/344] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 15:28:17 2023] POST /compute/v2.1/servers => generated 403 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 15:28:17 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-b1364874-b320-485f-8934-3f861950f591 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:28:17 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-b1364874-b320-485f-8934-3f861950f591 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:28:17 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-b1364874-b320-485f-8934-3f861950f591 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32986358bcc4148ad3f361e3944ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dec4b679f24d1e85b1105b4849cddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:28:17 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-b1364874-b320-485f-8934-3f861950f591 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f32986358bcc4148ad3f361e3944ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dec4b679f24d1e85b1105b4849cddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:28:17 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-b1364874-b320-485f-8934-3f861950f591 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f32986358bcc4148ad3f361e3944ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dec4b679f24d1e85b1105b4849cddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:28:17 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-b1364874-b320-485f-8934-3f861950f591 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" status: 200 len: 1320 microversion: 2.49 time: 0.093757 Apr 11 15:28:17 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 116/345] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:28:17 2023] GET /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a => generated 1320 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:28:20 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-30e954a2-cf48-4d32-b8bb-d4a075a36953 req-ebbf71a0-6ee2-43c1-aa0f-6631fdb1cc1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a", "tag": "40f1797d-278c-4676-8413-3b0c0f113dd9"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:28:20 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-30e954a2-cf48-4d32-b8bb-d4a075a36953 req-ebbf71a0-6ee2-43c1-aa0f-6631fdb1cc1b service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:20 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-30e954a2-cf48-4d32-b8bb-d4a075a36953 req-ebbf71a0-6ee2-43c1-aa0f-6631fdb1cc1b service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:20 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-30e954a2-cf48-4d32-b8bb-d4a075a36953 req-ebbf71a0-6ee2-43c1-aa0f-6631fdb1cc1b service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:20 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-30e954a2-cf48-4d32-b8bb-d4a075a36953 req-ebbf71a0-6ee2-43c1-aa0f-6631fdb1cc1b service nova] Creating event network-changed:40f1797d-278c-4676-8413-3b0c0f113dd9 for instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a on user Apr 11 15:28:20 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-30e954a2-cf48-4d32-b8bb-d4a075a36953 req-ebbf71a0-6ee2-43c1-aa0f-6631fdb1cc1b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031584 Apr 11 15:28:20 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 116/346] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:28:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:28:22 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-0c87599f-92c1-486c-b682-2359bec3fa89 req-7cc2fedf-04bd-4d7f-9f96-24164ac8afef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a", "name": "network-vif-plugged", "status": "completed", "tag": "40f1797d-278c-4676-8413-3b0c0f113dd9"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:28:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-0c87599f-92c1-486c-b682-2359bec3fa89 req-7cc2fedf-04bd-4d7f-9f96-24164ac8afef service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-0c87599f-92c1-486c-b682-2359bec3fa89 req-7cc2fedf-04bd-4d7f-9f96-24164ac8afef service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-0c87599f-92c1-486c-b682-2359bec3fa89 req-7cc2fedf-04bd-4d7f-9f96-24164ac8afef service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:22 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-0c87599f-92c1-486c-b682-2359bec3fa89 req-7cc2fedf-04bd-4d7f-9f96-24164ac8afef service nova] Creating event network-vif-plugged:40f1797d-278c-4676-8413-3b0c0f113dd9 for instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a on user Apr 11 15:28:22 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-0c87599f-92c1-486c-b682-2359bec3fa89 req-7cc2fedf-04bd-4d7f-9f96-24164ac8afef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034775 Apr 11 15:28:22 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 115/347] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:28:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:28:24 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:28:24 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:28:24 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:24 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:24 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:24 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:24 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:24 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:24 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61167) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 11 15:28:24 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-67445046-ba32-4860-9514-f2e722b944fb req-a5a53f9b-6373-40e8-a97d-5615e32b49fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a", "name": "network-vif-plugged", "status": "completed", "tag": "40f1797d-278c-4676-8413-3b0c0f113dd9"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:28:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-67445046-ba32-4860-9514-f2e722b944fb req-a5a53f9b-6373-40e8-a97d-5615e32b49fd service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:24 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] 10.0.0.210 "POST /compute/v2.1/servers/39e3dfb1-bc09-474d-b8cb-f01b11923eae/action" status: 202 len: 0 microversion: 2.1 time: 0.100526 Apr 11 15:28:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-67445046-ba32-4860-9514-f2e722b944fb req-a5a53f9b-6373-40e8-a97d-5615e32b49fd service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-67445046-ba32-4860-9514-f2e722b944fb req-a5a53f9b-6373-40e8-a97d-5615e32b49fd service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:24 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 117/348] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 15:28:24 2023] POST /compute/v2.1/servers/39e3dfb1-bc09-474d-b8cb-f01b11923eae/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:28:24 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-c9a32288-dd16-4ce9-994f-ef9ea242ff18 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:28:24 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-c9a32288-dd16-4ce9-994f-ef9ea242ff18 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:28:24 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-67445046-ba32-4860-9514-f2e722b944fb req-a5a53f9b-6373-40e8-a97d-5615e32b49fd service nova] Creating event network-vif-plugged:40f1797d-278c-4676-8413-3b0c0f113dd9 for instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a on user Apr 11 15:28:24 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-67445046-ba32-4860-9514-f2e722b944fb req-a5a53f9b-6373-40e8-a97d-5615e32b49fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037493 Apr 11 15:28:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c9a32288-dd16-4ce9-994f-ef9ea242ff18 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c9a32288-dd16-4ce9-994f-ef9ea242ff18 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:24 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 117/349] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:28:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:28:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c9a32288-dd16-4ce9-994f-ef9ea242ff18 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c9a32288-dd16-4ce9-994f-ef9ea242ff18 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c9a32288-dd16-4ce9-994f-ef9ea242ff18 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c9a32288-dd16-4ce9-994f-ef9ea242ff18 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:25 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-c9a32288-dd16-4ce9-994f-ef9ea242ff18 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e1716b2bb2438b93d46dc8052c788b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ed867a40534b70bf75dc0cc28fdfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:28:25 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-c9a32288-dd16-4ce9-994f-ef9ea242ff18 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39e3dfb1-bc09-474d-b8cb-f01b11923eae" status: 200 len: 1509 microversion: 2.1 time: 0.172231 Apr 11 15:28:25 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 116/350] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:28:24 2023] GET /compute/v2.1/servers/39e3dfb1-bc09-474d-b8cb-f01b11923eae => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:28:26 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-981e970b-8219-4250-aa58-b4d42585a349 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:28:26 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-981e970b-8219-4250-aa58-b4d42585a349 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:28:26 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-981e970b-8219-4250-aa58-b4d42585a349 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:26 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-981e970b-8219-4250-aa58-b4d42585a349 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:26 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-981e970b-8219-4250-aa58-b4d42585a349 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:26 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-981e970b-8219-4250-aa58-b4d42585a349 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:26 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-981e970b-8219-4250-aa58-b4d42585a349 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:26 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-981e970b-8219-4250-aa58-b4d42585a349 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:26 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-981e970b-8219-4250-aa58-b4d42585a349 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:28:26 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-981e970b-8219-4250-aa58-b4d42585a349 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:28:26 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-981e970b-8219-4250-aa58-b4d42585a349 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:28:26 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-981e970b-8219-4250-aa58-b4d42585a349 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0d90fd2-6a95-43c4-8756-e82071d99154" status: 200 len: 1768 microversion: 2.87 time: 0.231306 Apr 11 15:28:26 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 118/351] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:28:26 2023] GET /compute/v2.1/servers/b0d90fd2-6a95-43c4-8756-e82071d99154 => generated 1768 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:28:31 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:28:31 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-f07a78e7-61c3-488b-add7-dbfc0248f341 req-aede65f1-9a10-4aff-8aaa-65a4859b50af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39e3dfb1-bc09-474d-b8cb-f01b11923eae", "tag": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:28:31 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-f07a78e7-61c3-488b-add7-dbfc0248f341 req-aede65f1-9a10-4aff-8aaa-65a4859b50af service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:31 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-f07a78e7-61c3-488b-add7-dbfc0248f341 req-aede65f1-9a10-4aff-8aaa-65a4859b50af service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:31 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-f07a78e7-61c3-488b-add7-dbfc0248f341 req-aede65f1-9a10-4aff-8aaa-65a4859b50af service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:31 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-f07a78e7-61c3-488b-add7-dbfc0248f341 req-aede65f1-9a10-4aff-8aaa-65a4859b50af service nova] Creating event network-changed:21d628ba-6bae-4d98-94df-bb6fbb4f1c24 for instance 39e3dfb1-bc09-474d-b8cb-f01b11923eae on user Apr 11 15:28:31 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-f07a78e7-61c3-488b-add7-dbfc0248f341 req-aede65f1-9a10-4aff-8aaa-65a4859b50af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055314 Apr 11 15:28:31 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 118/352] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:28:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:28:32 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-1b1060fd-b820-47e1-9257-f187bcb8bce8 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:28:32 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-1b1060fd-b820-47e1-9257-f187bcb8bce8 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:28:32 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:28:32 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:28:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1b1060fd-b820-47e1-9257-f187bcb8bce8 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1b1060fd-b820-47e1-9257-f187bcb8bce8 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1b1060fd-b820-47e1-9257-f187bcb8bce8 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1b1060fd-b820-47e1-9257-f187bcb8bce8 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1b1060fd-b820-47e1-9257-f187bcb8bce8 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1b1060fd-b820-47e1-9257-f187bcb8bce8 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:32 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-1b1060fd-b820-47e1-9257-f187bcb8bce8 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ece3baa634583a7cc3000c78f2c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bfd48094c54cd5b13dabf27ebdd5dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:28:32 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-1b1060fd-b820-47e1-9257-f187bcb8bce8 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896" status: 200 len: 1567 microversion: 2.1 time: 0.190212 Apr 11 15:28:32 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 117/353] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:28:32 2023] GET /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896 => generated 1567 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:28:33 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:28:33 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:28:33 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:28:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:33 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Going to try to terminate instance {{(pid=61167) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:28:33 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5" status: 204 len: 0 microversion: 2.1 time: 0.207214 Apr 11 15:28:33 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 119/354] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:28:33 2023] DELETE /compute/v2.1/servers/fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:28:33 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-490eec1d-083a-4f60-b5c5-67303c8ed400 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:28:33 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-490eec1d-083a-4f60-b5c5-67303c8ed400 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:28:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-490eec1d-083a-4f60-b5c5-67303c8ed400 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-490eec1d-083a-4f60-b5c5-67303c8ed400 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-490eec1d-083a-4f60-b5c5-67303c8ed400 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-490eec1d-083a-4f60-b5c5-67303c8ed400 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-490eec1d-083a-4f60-b5c5-67303c8ed400 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-490eec1d-083a-4f60-b5c5-67303c8ed400 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:33 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-490eec1d-083a-4f60-b5c5-67303c8ed400 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c7f9af6776413c91e2638712a142f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c879d28040aba0ebc76bc2a80693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:28:33 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-490eec1d-083a-4f60-b5c5-67303c8ed400 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5" status: 200 len: 1490 microversion: 2.1 time: 0.205416 Apr 11 15:28:33 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 119/355] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:28:33 2023] GET /compute/v2.1/servers/fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5 => generated 1490 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:28:33 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-04e100e0-9332-4e54-bbff-157873a1eeee req-fa103052-910f-4137-8b9f-cbc94dc505aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5", "name": "network-vif-unplugged", "status": "completed", "tag": "836289ee-6293-49b3-b0c2-7012ceae0c97"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:28:33 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-04e100e0-9332-4e54-bbff-157873a1eeee req-fa103052-910f-4137-8b9f-cbc94dc505aa service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:33 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-04e100e0-9332-4e54-bbff-157873a1eeee req-fa103052-910f-4137-8b9f-cbc94dc505aa service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:33 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-04e100e0-9332-4e54-bbff-157873a1eeee req-fa103052-910f-4137-8b9f-cbc94dc505aa service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:33 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-04e100e0-9332-4e54-bbff-157873a1eeee req-fa103052-910f-4137-8b9f-cbc94dc505aa service nova] Creating event network-vif-unplugged:836289ee-6293-49b3-b0c2-7012ceae0c97 for instance fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5 on user Apr 11 15:28:33 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-04e100e0-9332-4e54-bbff-157873a1eeee req-fa103052-910f-4137-8b9f-cbc94dc505aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033625 Apr 11 15:28:33 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 118/356] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:28:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:28:35 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-6168acc8-76c9-4b25-8da3-8a22dc33eb4b req-ef390d4f-eb9f-44df-a557-ec685c4634ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5", "name": "network-vif-deleted", "tag": "836289ee-6293-49b3-b0c2-7012ceae0c97"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:28:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-6168acc8-76c9-4b25-8da3-8a22dc33eb4b req-ef390d4f-eb9f-44df-a557-ec685c4634ba service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-6168acc8-76c9-4b25-8da3-8a22dc33eb4b req-ef390d4f-eb9f-44df-a557-ec685c4634ba service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-6168acc8-76c9-4b25-8da3-8a22dc33eb4b req-ef390d4f-eb9f-44df-a557-ec685c4634ba service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:35 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-6168acc8-76c9-4b25-8da3-8a22dc33eb4b req-ef390d4f-eb9f-44df-a557-ec685c4634ba service nova] Creating event network-vif-deleted:836289ee-6293-49b3-b0c2-7012ceae0c97 for instance fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5 on user Apr 11 15:28:35 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-6168acc8-76c9-4b25-8da3-8a22dc33eb4b req-ef390d4f-eb9f-44df-a557-ec685c4634ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065758 Apr 11 15:28:35 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 120/357] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:28:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:28:35 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-92185f72-defe-440e-a70c-24fffc8dcaef req-83633bbd-39e4-4df1-9769-132261c9a433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e3dfb1-bc09-474d-b8cb-f01b11923eae", "name": "network-vif-plugged", "status": "completed", "tag": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:28:35 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-92185f72-defe-440e-a70c-24fffc8dcaef req-83633bbd-39e4-4df1-9769-132261c9a433 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:35 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-92185f72-defe-440e-a70c-24fffc8dcaef req-83633bbd-39e4-4df1-9769-132261c9a433 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:35 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-92185f72-defe-440e-a70c-24fffc8dcaef req-83633bbd-39e4-4df1-9769-132261c9a433 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:35 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-92185f72-defe-440e-a70c-24fffc8dcaef req-83633bbd-39e4-4df1-9769-132261c9a433 service nova] Creating event network-vif-plugged:21d628ba-6bae-4d98-94df-bb6fbb4f1c24 for instance 39e3dfb1-bc09-474d-b8cb-f01b11923eae on user Apr 11 15:28:35 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5", "name": "network-vif-plugged", "status": "completed", "tag": "836289ee-6293-49b3-b0c2-7012ceae0c97"}, {"server_uuid": "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5", "name": "network-vif-plugged", "status": "completed", "tag": "836289ee-6293-49b3-b0c2-7012ceae0c97"}, {"server_uuid": "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5", "name": "network-vif-plugged", "status": "completed", "tag": "836289ee-6293-49b3-b0c2-7012ceae0c97"}, {"server_uuid": "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5", "name": "network-vif-unplugged", "status": "completed", "tag": "836289ee-6293-49b3-b0c2-7012ceae0c97"}, {"server_uuid": "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5", "name": "network-vif-plugged", "status": "completed", "tag": "836289ee-6293-49b3-b0c2-7012ceae0c97"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:28:35 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-92185f72-defe-440e-a70c-24fffc8dcaef req-83633bbd-39e4-4df1-9769-132261c9a433 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043425 Apr 11 15:28:35 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 120/358] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:28:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:28:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:35 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] Creating event network-vif-plugged:836289ee-6293-49b3-b0c2-7012ceae0c97 for instance fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5 on user Apr 11 15:28:35 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] Creating event network-vif-plugged:836289ee-6293-49b3-b0c2-7012ceae0c97 for instance fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5 on user Apr 11 15:28:35 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] Creating event network-vif-plugged:836289ee-6293-49b3-b0c2-7012ceae0c97 for instance fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5 on user Apr 11 15:28:35 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] Creating event network-vif-unplugged:836289ee-6293-49b3-b0c2-7012ceae0c97 for instance fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5 on user Apr 11 15:28:35 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] Creating event network-vif-plugged:836289ee-6293-49b3-b0c2-7012ceae0c97 for instance fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5 on user Apr 11 15:28:35 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.059471 Apr 11 15:28:35 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 119/359] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:28:35 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:28:37 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-5bd479b0-4d22-4726-88b1-001517ab7c68 req-a4f71964-9a42-4638-bcc6-0e035d2b51de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e3dfb1-bc09-474d-b8cb-f01b11923eae", "name": "network-vif-plugged", "status": "completed", "tag": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:28:37 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-5bd479b0-4d22-4726-88b1-001517ab7c68 req-a4f71964-9a42-4638-bcc6-0e035d2b51de service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:37 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-5bd479b0-4d22-4726-88b1-001517ab7c68 req-a4f71964-9a42-4638-bcc6-0e035d2b51de service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:37 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-5bd479b0-4d22-4726-88b1-001517ab7c68 req-a4f71964-9a42-4638-bcc6-0e035d2b51de service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:37 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-5bd479b0-4d22-4726-88b1-001517ab7c68 req-a4f71964-9a42-4638-bcc6-0e035d2b51de service nova] Creating event network-vif-plugged:21d628ba-6bae-4d98-94df-bb6fbb4f1c24 for instance 39e3dfb1-bc09-474d-b8cb-f01b11923eae on user Apr 11 15:28:37 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-5bd479b0-4d22-4726-88b1-001517ab7c68 req-a4f71964-9a42-4638-bcc6-0e035d2b51de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028380 Apr 11 15:28:37 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 121/360] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:28:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:28:38 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-5e440721-2e8b-4482-89f9-ec72baec8daf tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:28:38 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-5e440721-2e8b-4482-89f9-ec72baec8daf tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:28:38 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5e440721-2e8b-4482-89f9-ec72baec8daf tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:38 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5e440721-2e8b-4482-89f9-ec72baec8daf tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:38 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5e440721-2e8b-4482-89f9-ec72baec8daf tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:38 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5e440721-2e8b-4482-89f9-ec72baec8daf tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:38 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5e440721-2e8b-4482-89f9-ec72baec8daf tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:38 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5e440721-2e8b-4482-89f9-ec72baec8daf tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:38 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-5e440721-2e8b-4482-89f9-ec72baec8daf tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:28:38 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-5e440721-2e8b-4482-89f9-ec72baec8daf tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:28:38 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-5e440721-2e8b-4482-89f9-ec72baec8daf tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:28:38 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-5e440721-2e8b-4482-89f9-ec72baec8daf tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" status: 200 len: 1784 microversion: 2.20 time: 0.166801 Apr 11 15:28:38 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 121/361] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:28:38 2023] GET /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d => generated 1784 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:28:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-b07a0c8c-d169-4c33-bf1f-fc2f16884382 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:28:39 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-b07a0c8c-d169-4c33-bf1f-fc2f16884382 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:28:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b07a0c8c-d169-4c33-bf1f-fc2f16884382 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b07a0c8c-d169-4c33-bf1f-fc2f16884382 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b07a0c8c-d169-4c33-bf1f-fc2f16884382 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b07a0c8c-d169-4c33-bf1f-fc2f16884382 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b07a0c8c-d169-4c33-bf1f-fc2f16884382 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b07a0c8c-d169-4c33-bf1f-fc2f16884382 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:39 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-b07a0c8c-d169-4c33-bf1f-fc2f16884382 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046204 Apr 11 15:28:39 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 120/362] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:28:39 2023] GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 15:28:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-ca5c72f6-c19e-43d3-bcea-b1dcdf2ee173 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:28:40 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-ca5c72f6-c19e-43d3-bcea-b1dcdf2ee173 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:28:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ca5c72f6-c19e-43d3-bcea-b1dcdf2ee173 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ca5c72f6-c19e-43d3-bcea-b1dcdf2ee173 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ca5c72f6-c19e-43d3-bcea-b1dcdf2ee173 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ca5c72f6-c19e-43d3-bcea-b1dcdf2ee173 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ca5c72f6-c19e-43d3-bcea-b1dcdf2ee173 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ca5c72f6-c19e-43d3-bcea-b1dcdf2ee173 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:40 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-ca5c72f6-c19e-43d3-bcea-b1dcdf2ee173 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:28:40 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-ca5c72f6-c19e-43d3-bcea-b1dcdf2ee173 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35" status: 200 len: 1677 microversion: 2.1 time: 0.158426 Apr 11 15:28:40 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 122/363] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:28:40 2023] GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:28:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-cd4dfc49-9b4c-4d2b-b74f-72cd4542c365 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:28:40 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-cd4dfc49-9b4c-4d2b-b74f-72cd4542c365 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:28:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cd4dfc49-9b4c-4d2b-b74f-72cd4542c365 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cd4dfc49-9b4c-4d2b-b74f-72cd4542c365 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cd4dfc49-9b4c-4d2b-b74f-72cd4542c365 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cd4dfc49-9b4c-4d2b-b74f-72cd4542c365 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cd4dfc49-9b4c-4d2b-b74f-72cd4542c365 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cd4dfc49-9b4c-4d2b-b74f-72cd4542c365 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:40 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-cd4dfc49-9b4c-4d2b-b74f-72cd4542c365 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:28:40 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-cd4dfc49-9b4c-4d2b-b74f-72cd4542c365 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35" status: 200 len: 1677 microversion: 2.1 time: 0.148821 Apr 11 15:28:40 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 122/364] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:28:40 2023] GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:28:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-4322ff03-789a-4c18-918e-b6c1543d2a56 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:28:40 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-4322ff03-789a-4c18-918e-b6c1543d2a56 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:28:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4322ff03-789a-4c18-918e-b6c1543d2a56 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4322ff03-789a-4c18-918e-b6c1543d2a56 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4322ff03-789a-4c18-918e-b6c1543d2a56 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4322ff03-789a-4c18-918e-b6c1543d2a56 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4322ff03-789a-4c18-918e-b6c1543d2a56 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4322ff03-789a-4c18-918e-b6c1543d2a56 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:40 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-4322ff03-789a-4c18-918e-b6c1543d2a56 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:28:40 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-4322ff03-789a-4c18-918e-b6c1543d2a56 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35" status: 200 len: 1677 microversion: 2.1 time: 0.145313 Apr 11 15:28:40 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 121/365] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:28:40 2023] GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35 => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:28:43 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:28:43 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:28:43 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:43 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:43 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:43 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:43 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:43 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:43 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Going to try to terminate instance {{(pid=61167) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:28:43 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f846ecc9-ecc4-4e8f-aca3-39d83b56f414" status: 204 len: 0 microversion: 2.1 time: 0.106357 Apr 11 15:28:43 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 123/366] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:28:43 2023] DELETE /compute/v2.1/servers/f846ecc9-ecc4-4e8f-aca3-39d83b56f414 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:28:43 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-b9c8f437-25ad-4c3a-b710-e2fd8445997a tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:28:43 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-b9c8f437-25ad-4c3a-b710-e2fd8445997a tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:28:43 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b9c8f437-25ad-4c3a-b710-e2fd8445997a tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:43 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b9c8f437-25ad-4c3a-b710-e2fd8445997a tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:43 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b9c8f437-25ad-4c3a-b710-e2fd8445997a tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:43 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b9c8f437-25ad-4c3a-b710-e2fd8445997a tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:43 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b9c8f437-25ad-4c3a-b710-e2fd8445997a tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:43 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b9c8f437-25ad-4c3a-b710-e2fd8445997a tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:43 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-b9c8f437-25ad-4c3a-b710-e2fd8445997a tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2538af5c739404aa433b766976e5b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561130d089c8415297697bcedc93aefc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:28:43 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-b9c8f437-25ad-4c3a-b710-e2fd8445997a tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f846ecc9-ecc4-4e8f-aca3-39d83b56f414" status: 200 len: 1499 microversion: 2.1 time: 0.181579 Apr 11 15:28:43 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 123/367] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:28:43 2023] GET /compute/v2.1/servers/f846ecc9-ecc4-4e8f-aca3-39d83b56f414 => generated 1499 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:28:43 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-9c9ae32c-60c5-4a16-8d91-f079720974a0 req-ddbb96a8-0c8e-43b6-ad54-bec14a24c9a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f846ecc9-ecc4-4e8f-aca3-39d83b56f414", "name": "network-vif-unplugged", "status": "completed", "tag": "ce99a25f-dfdb-4798-8830-d2f4a66e6cc8"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:28:43 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-9c9ae32c-60c5-4a16-8d91-f079720974a0 req-ddbb96a8-0c8e-43b6-ad54-bec14a24c9a5 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:43 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-9c9ae32c-60c5-4a16-8d91-f079720974a0 req-ddbb96a8-0c8e-43b6-ad54-bec14a24c9a5 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:43 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-9c9ae32c-60c5-4a16-8d91-f079720974a0 req-ddbb96a8-0c8e-43b6-ad54-bec14a24c9a5 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:43 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-9c9ae32c-60c5-4a16-8d91-f079720974a0 req-ddbb96a8-0c8e-43b6-ad54-bec14a24c9a5 service nova] Creating event network-vif-unplugged:ce99a25f-dfdb-4798-8830-d2f4a66e6cc8 for instance f846ecc9-ecc4-4e8f-aca3-39d83b56f414 on user Apr 11 15:28:43 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-9c9ae32c-60c5-4a16-8d91-f079720974a0 req-ddbb96a8-0c8e-43b6-ad54-bec14a24c9a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030215 Apr 11 15:28:43 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 122/368] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:28:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:28:44 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-6c0d58f4-ae80-4654-990e-429b6f7ac991 req-94fe4a36-a621-4322-bd1e-c809f99c52f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f846ecc9-ecc4-4e8f-aca3-39d83b56f414", "name": "network-vif-deleted", "tag": "ce99a25f-dfdb-4798-8830-d2f4a66e6cc8"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:28:44 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-6c0d58f4-ae80-4654-990e-429b6f7ac991 req-94fe4a36-a621-4322-bd1e-c809f99c52f7 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:44 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-6c0d58f4-ae80-4654-990e-429b6f7ac991 req-94fe4a36-a621-4322-bd1e-c809f99c52f7 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:44 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-6c0d58f4-ae80-4654-990e-429b6f7ac991 req-94fe4a36-a621-4322-bd1e-c809f99c52f7 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:44 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-6c0d58f4-ae80-4654-990e-429b6f7ac991 req-94fe4a36-a621-4322-bd1e-c809f99c52f7 service nova] Creating event network-vif-deleted:ce99a25f-dfdb-4798-8830-d2f4a66e6cc8 for instance f846ecc9-ecc4-4e8f-aca3-39d83b56f414 on user Apr 11 15:28:44 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-6c0d58f4-ae80-4654-990e-429b6f7ac991 req-94fe4a36-a621-4322-bd1e-c809f99c52f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029936 Apr 11 15:28:44 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 124/369] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:28:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:28:46 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-0d1b70ae-c788-43ed-8d74-c21b196c94a9 req-53e97fb2-9664-4b7d-a6ae-7a465e8a9de0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f846ecc9-ecc4-4e8f-aca3-39d83b56f414", "name": "network-vif-plugged", "status": "completed", "tag": "ce99a25f-dfdb-4798-8830-d2f4a66e6cc8"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:28:46 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:28:46 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-0d1b70ae-c788-43ed-8d74-c21b196c94a9 req-53e97fb2-9664-4b7d-a6ae-7a465e8a9de0 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:28:46 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-0d1b70ae-c788-43ed-8d74-c21b196c94a9 req-53e97fb2-9664-4b7d-a6ae-7a465e8a9de0 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:28:46 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-0d1b70ae-c788-43ed-8d74-c21b196c94a9 req-53e97fb2-9664-4b7d-a6ae-7a465e8a9de0 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:28:46 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=33 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:28:46 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-0d1b70ae-c788-43ed-8d74-c21b196c94a9 req-53e97fb2-9664-4b7d-a6ae-7a465e8a9de0 service nova] Creating event network-vif-plugged:ce99a25f-dfdb-4798-8830-d2f4a66e6cc8 for instance f846ecc9-ecc4-4e8f-aca3-39d83b56f414 on user Apr 11 15:28:46 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-0d1b70ae-c788-43ed-8d74-c21b196c94a9 req-53e97fb2-9664-4b7d-a6ae-7a465e8a9de0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033974 Apr 11 15:28:46 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 124/370] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:28:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:29:08 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:29:08 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=34 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:29:08 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-e641081e-ba2f-4c76-952f-1c3770fd61ae tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:29:08 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-e641081e-ba2f-4c76-952f-1c3770fd61ae tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:29:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e641081e-ba2f-4c76-952f-1c3770fd61ae tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e641081e-ba2f-4c76-952f-1c3770fd61ae tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e641081e-ba2f-4c76-952f-1c3770fd61ae tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e641081e-ba2f-4c76-952f-1c3770fd61ae tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e641081e-ba2f-4c76-952f-1c3770fd61ae tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e641081e-ba2f-4c76-952f-1c3770fd61ae tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:08 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-e641081e-ba2f-4c76-952f-1c3770fd61ae tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32986358bcc4148ad3f361e3944ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dec4b679f24d1e85b1105b4849cddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:29:08 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-e641081e-ba2f-4c76-952f-1c3770fd61ae tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f32986358bcc4148ad3f361e3944ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dec4b679f24d1e85b1105b4849cddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:29:08 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-e641081e-ba2f-4c76-952f-1c3770fd61ae tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f32986358bcc4148ad3f361e3944ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dec4b679f24d1e85b1105b4849cddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:29:08 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-e641081e-ba2f-4c76-952f-1c3770fd61ae tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" status: 200 len: 1626 microversion: 2.49 time: 0.158690 Apr 11 15:29:08 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 123/371] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:29:08 2023] GET /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a => generated 1626 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:29:15 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=3 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:29:15 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:29:15 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-7e3f4028-854d-4320-bb71-06f72e9716a4 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:29:15 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-7e3f4028-854d-4320-bb71-06f72e9716a4 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:29:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7e3f4028-854d-4320-bb71-06f72e9716a4 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7e3f4028-854d-4320-bb71-06f72e9716a4 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7e3f4028-854d-4320-bb71-06f72e9716a4 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7e3f4028-854d-4320-bb71-06f72e9716a4 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7e3f4028-854d-4320-bb71-06f72e9716a4 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7e3f4028-854d-4320-bb71-06f72e9716a4 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:15 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-7e3f4028-854d-4320-bb71-06f72e9716a4 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e1716b2bb2438b93d46dc8052c788b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ed867a40534b70bf75dc0cc28fdfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:29:15 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-7e3f4028-854d-4320-bb71-06f72e9716a4 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39e3dfb1-bc09-474d-b8cb-f01b11923eae" status: 200 len: 1554 microversion: 2.1 time: 0.158773 Apr 11 15:29:15 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 125/372] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:29:15 2023] GET /compute/v2.1/servers/39e3dfb1-bc09-474d-b8cb-f01b11923eae => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:29:23 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:29:23 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:29:23 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-7736ee32-61ae-4273-bcf1-1044ee35a282 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:29:23 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-7736ee32-61ae-4273-bcf1-1044ee35a282 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:29:23 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7736ee32-61ae-4273-bcf1-1044ee35a282 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:23 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7736ee32-61ae-4273-bcf1-1044ee35a282 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:23 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7736ee32-61ae-4273-bcf1-1044ee35a282 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:23 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7736ee32-61ae-4273-bcf1-1044ee35a282 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:23 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7736ee32-61ae-4273-bcf1-1044ee35a282 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:23 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7736ee32-61ae-4273-bcf1-1044ee35a282 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:23 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-7736ee32-61ae-4273-bcf1-1044ee35a282 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] HTTP exception thrown: Instance fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5 could not be found. Apr 11 15:29:23 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-7736ee32-61ae-4273-bcf1-1044ee35a282 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Request method failure captured: Apr 11 15:29:23 user devstack@n-api.service[61165]: request: GET /compute/v2.1/servers/fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5 HTTP/1.1 Apr 11 15:29:23 user devstack@n-api.service[61165]: Accept: application/json Apr 11 15:29:23 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 15:29:23 user devstack@n-api.service[61165]: Connection: close Apr 11 15:29:23 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 15:29:23 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 15:29:23 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 15:29:23 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 15:29:23 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 15:29:23 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNXws3MGNxgjmDh762Jr4ut2LqKIov3UGhOhswolPSMTMuSAPqk2hJpBjqFL1BCVeomA9c2EuMzKFoZJ424kit0cbGLNFKcaMybUPvCrI0uMZGpTdfZo8I8QTuAxwZoq-4KRmvJcr_WQG8YLV8Mu7h9_YKIAN0yllivf6DWwrxQxcfLU Apr 11 15:29:23 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 15:29:23 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 15:29:23 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 15:29:23 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 15:29:23 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 15:29:23 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 15:29:23 user devstack@n-api.service[61165]: X-Project-Id: 14c9c879d28040aba0ebc76bc2a80693 Apr 11 15:29:23 user devstack@n-api.service[61165]: X-Project-Name: tempest-VolumesActionsTest-955235995 Apr 11 15:29:23 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 15:29:23 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 15:29:23 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/14c9c879d28040aba0ebc76bc2a80693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/14c9c879d28040aba0ebc76bc2a80693"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/14c9c879d28040aba0ebc76bc2a80693"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:29:23 user devstack@n-api.service[61165]: X-Tenant: tempest-VolumesActionsTest-955235995 Apr 11 15:29:23 user devstack@n-api.service[61165]: X-Tenant-Id: 14c9c879d28040aba0ebc76bc2a80693 Apr 11 15:29:23 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-VolumesActionsTest-955235995 Apr 11 15:29:23 user devstack@n-api.service[61165]: X-User: tempest-VolumesActionsTest-955235995-project-member Apr 11 15:29:23 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 15:29:23 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 15:29:23 user devstack@n-api.service[61165]: X-User-Id: 90c7f9af6776413c91e2638712a142f7 Apr 11 15:29:23 user devstack@n-api.service[61165]: X-User-Name: tempest-VolumesActionsTest-955235995-project-member Apr 11 15:29:23 user devstack@n-api.service[61165]: method: > Apr 11 15:29:23 user devstack@n-api.service[61165]: exception: Instance fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5 could not be found. Apr 11 15:29:23 user devstack@n-api.service[61165]: action_args: {'id': 'fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5'} Apr 11 15:29:23 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5 could not be found. Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5 could not be found. Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5 could not be found. Apr 11 15:29:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:29:23 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-7736ee32-61ae-4273-bcf1-1044ee35a282 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Returning 404 to user: Instance fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5 could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:29:23 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-7736ee32-61ae-4273-bcf1-1044ee35a282 tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5" status: 404 len: 111 microversion: 2.1 time: 0.043532 Apr 11 15:29:23 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 125/373] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:29:23 2023] GET /compute/v2.1/servers/fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:29:26 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-858493461", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "networks": [{"uuid": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef"}]}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:29:26 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:29:26 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:29:26 user devstack@n-api.service[61166]: DEBUG nova.network.neutron [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] validate_networks() for [('1cf4cec3-ff08-4320-89e4-aa7e8cf75eef', None, None, None, None, None)] {{(pid=61166) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:29:27 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Flavor limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:29:27 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Image limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:29:27 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Flavor pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:29:27 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Image pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:29:27 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:29:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:27 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Getting quotas for project ddc05e9bf5ab426982ccb3092ad596e4. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:29:27 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Getting quotas for user 1d60ce27bfad4d7c9b976e834df35ad4 and project ddc05e9bf5ab426982ccb3092ad596e4. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:29:27 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Going to run 1 instances... {{(pid=61166) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:29:27 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52fe638c-5ada-47d5-b376-233bfa808a37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:29:27 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.577680 Apr 11 15:29:27 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 124/374] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 15:29:26 2023] POST /compute/v2.1/servers => generated 378 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 15:29:27 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-d84303fe-e925-40be-95e9-87de17a93cdd tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:29:27 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-d84303fe-e925-40be-95e9-87de17a93cdd tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:29:27 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:29:27 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:29:27 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-d84303fe-e925-40be-95e9-87de17a93cdd tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:29:27 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-d84303fe-e925-40be-95e9-87de17a93cdd tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:29:27 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-d84303fe-e925-40be-95e9-87de17a93cdd tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:29:27 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-d84303fe-e925-40be-95e9-87de17a93cdd tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c4329ae-07cb-4f28-9fd6-29b398517d2b" status: 200 len: 1394 microversion: 2.87 time: 0.088412 Apr 11 15:29:27 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 126/375] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:29:27 2023] GET /compute/v2.1/servers/7c4329ae-07cb-4f28-9fd6-29b398517d2b => generated 1394 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:29:30 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-73388cac-5943-4a85-9e9c-ebf628d492e6 req-3297c749-4c15-4c56-9dd8-6671beef143f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c4329ae-07cb-4f28-9fd6-29b398517d2b", "tag": "37d248cb-99ae-4dcd-adfe-46bce9920d3e"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:29:30 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-73388cac-5943-4a85-9e9c-ebf628d492e6 req-3297c749-4c15-4c56-9dd8-6671beef143f service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:30 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-73388cac-5943-4a85-9e9c-ebf628d492e6 req-3297c749-4c15-4c56-9dd8-6671beef143f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:30 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-73388cac-5943-4a85-9e9c-ebf628d492e6 req-3297c749-4c15-4c56-9dd8-6671beef143f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:30 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-73388cac-5943-4a85-9e9c-ebf628d492e6 req-3297c749-4c15-4c56-9dd8-6671beef143f service nova] Creating event network-changed:37d248cb-99ae-4dcd-adfe-46bce9920d3e for instance 7c4329ae-07cb-4f28-9fd6-29b398517d2b on user Apr 11 15:29:30 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-73388cac-5943-4a85-9e9c-ebf628d492e6 req-3297c749-4c15-4c56-9dd8-6671beef143f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034843 Apr 11 15:29:30 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 126/376] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:29:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:29:32 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-3832d850-833c-4c74-ac7c-6b5516f69ebb req-efa3c20d-b1d9-4f19-8242-79be86f83f15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c4329ae-07cb-4f28-9fd6-29b398517d2b", "name": "network-vif-plugged", "status": "completed", "tag": "37d248cb-99ae-4dcd-adfe-46bce9920d3e"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:29:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-3832d850-833c-4c74-ac7c-6b5516f69ebb req-efa3c20d-b1d9-4f19-8242-79be86f83f15 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-3832d850-833c-4c74-ac7c-6b5516f69ebb req-efa3c20d-b1d9-4f19-8242-79be86f83f15 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-3832d850-833c-4c74-ac7c-6b5516f69ebb req-efa3c20d-b1d9-4f19-8242-79be86f83f15 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:32 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-3832d850-833c-4c74-ac7c-6b5516f69ebb req-efa3c20d-b1d9-4f19-8242-79be86f83f15 service nova] Creating event network-vif-plugged:37d248cb-99ae-4dcd-adfe-46bce9920d3e for instance 7c4329ae-07cb-4f28-9fd6-29b398517d2b on user Apr 11 15:29:32 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-3832d850-833c-4c74-ac7c-6b5516f69ebb req-efa3c20d-b1d9-4f19-8242-79be86f83f15 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037607 Apr 11 15:29:32 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 125/377] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:29:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 15:29:32 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-2ad54eec-acc2-4005-b983-6ec1e9db5b40 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:29:33 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-2ad54eec-acc2-4005-b983-6ec1e9db5b40 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:29:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2ad54eec-acc2-4005-b983-6ec1e9db5b40 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2ad54eec-acc2-4005-b983-6ec1e9db5b40 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2ad54eec-acc2-4005-b983-6ec1e9db5b40 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2ad54eec-acc2-4005-b983-6ec1e9db5b40 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2ad54eec-acc2-4005-b983-6ec1e9db5b40 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2ad54eec-acc2-4005-b983-6ec1e9db5b40 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:33 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-2ad54eec-acc2-4005-b983-6ec1e9db5b40 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ece3baa634583a7cc3000c78f2c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bfd48094c54cd5b13dabf27ebdd5dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:29:33 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-2ad54eec-acc2-4005-b983-6ec1e9db5b40 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896" status: 200 len: 1567 microversion: 2.1 time: 0.143438 Apr 11 15:29:33 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 127/378] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:29:32 2023] GET /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896 => generated 1567 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:29:33 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-4ffcf478-8f9a-41fe-a0f2-a391c5cefa47 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:29:33 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-4ffcf478-8f9a-41fe-a0f2-a391c5cefa47 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:29:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4ffcf478-8f9a-41fe-a0f2-a391c5cefa47 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4ffcf478-8f9a-41fe-a0f2-a391c5cefa47 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4ffcf478-8f9a-41fe-a0f2-a391c5cefa47 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4ffcf478-8f9a-41fe-a0f2-a391c5cefa47 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4ffcf478-8f9a-41fe-a0f2-a391c5cefa47 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4ffcf478-8f9a-41fe-a0f2-a391c5cefa47 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:33 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-4ffcf478-8f9a-41fe-a0f2-a391c5cefa47 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] HTTP exception thrown: Instance f846ecc9-ecc4-4e8f-aca3-39d83b56f414 could not be found. Apr 11 15:29:33 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-4ffcf478-8f9a-41fe-a0f2-a391c5cefa47 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Request method failure captured: Apr 11 15:29:33 user devstack@n-api.service[61165]: request: GET /compute/v2.1/servers/f846ecc9-ecc4-4e8f-aca3-39d83b56f414 HTTP/1.1 Apr 11 15:29:33 user devstack@n-api.service[61165]: Accept: application/json Apr 11 15:29:33 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 15:29:33 user devstack@n-api.service[61165]: Connection: close Apr 11 15:29:33 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 15:29:33 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 15:29:33 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 15:29:33 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 15:29:33 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 15:29:33 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNXvMrH6hVnA2_xtO12AnSS5L7tEtwltB42V7STqsPFkX1siG8cfx_r3xlA_cAVKU27_eB9mKFYmGM82hgnKgyfM_OCR91O4dZnnWcDasgDkQQ-8ZcPNgPDHtZ3233inf1KKXEOG3V3YOkacFYgC3v5ZLP-n8TcnC_TXgpNqxxNh7uAA Apr 11 15:29:33 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 15:29:33 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 15:29:33 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 15:29:33 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 15:29:33 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 15:29:33 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 15:29:33 user devstack@n-api.service[61165]: X-Project-Id: 561130d089c8415297697bcedc93aefc Apr 11 15:29:33 user devstack@n-api.service[61165]: X-Project-Name: tempest-ServersNegativeTestJSON-1004375615 Apr 11 15:29:33 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 15:29:33 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 15:29:33 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/561130d089c8415297697bcedc93aefc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/561130d089c8415297697bcedc93aefc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/561130d089c8415297697bcedc93aefc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:29:33 user devstack@n-api.service[61165]: X-Tenant: tempest-ServersNegativeTestJSON-1004375615 Apr 11 15:29:33 user devstack@n-api.service[61165]: X-Tenant-Id: 561130d089c8415297697bcedc93aefc Apr 11 15:29:33 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1004375615 Apr 11 15:29:33 user devstack@n-api.service[61165]: X-User: tempest-ServersNegativeTestJSON-1004375615-project-member Apr 11 15:29:33 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 15:29:33 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 15:29:33 user devstack@n-api.service[61165]: X-User-Id: b2538af5c739404aa433b766976e5b2d Apr 11 15:29:33 user devstack@n-api.service[61165]: X-User-Name: tempest-ServersNegativeTestJSON-1004375615-project-member Apr 11 15:29:33 user devstack@n-api.service[61165]: method: > Apr 11 15:29:33 user devstack@n-api.service[61165]: exception: Instance f846ecc9-ecc4-4e8f-aca3-39d83b56f414 could not be found. Apr 11 15:29:33 user devstack@n-api.service[61165]: action_args: {'id': 'f846ecc9-ecc4-4e8f-aca3-39d83b56f414'} Apr 11 15:29:33 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f846ecc9-ecc4-4e8f-aca3-39d83b56f414 could not be found. Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f846ecc9-ecc4-4e8f-aca3-39d83b56f414 could not be found. Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f846ecc9-ecc4-4e8f-aca3-39d83b56f414 could not be found. Apr 11 15:29:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:29:33 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-4ffcf478-8f9a-41fe-a0f2-a391c5cefa47 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Returning 404 to user: Instance f846ecc9-ecc4-4e8f-aca3-39d83b56f414 could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:29:33 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-4ffcf478-8f9a-41fe-a0f2-a391c5cefa47 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f846ecc9-ecc4-4e8f-aca3-39d83b56f414" status: 404 len: 111 microversion: 2.1 time: 0.038638 Apr 11 15:29:33 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 127/379] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:29:33 2023] GET /compute/v2.1/servers/f846ecc9-ecc4-4e8f-aca3-39d83b56f414 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:29:33 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-7c55d1da-0b34-4eab-a3fa-0a5207986314 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:29:33 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-7c55d1da-0b34-4eab-a3fa-0a5207986314 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:29:33 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-7c55d1da-0b34-4eab-a3fa-0a5207986314 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:33 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-7c55d1da-0b34-4eab-a3fa-0a5207986314 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:33 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-7c55d1da-0b34-4eab-a3fa-0a5207986314 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:33 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-7c55d1da-0b34-4eab-a3fa-0a5207986314 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:33 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-7c55d1da-0b34-4eab-a3fa-0a5207986314 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:33 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-7c55d1da-0b34-4eab-a3fa-0a5207986314 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:33 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-7c55d1da-0b34-4eab-a3fa-0a5207986314 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2538af5c739404aa433b766976e5b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561130d089c8415297697bcedc93aefc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:29:33 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-7c55d1da-0b34-4eab-a3fa-0a5207986314 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4555892-7abb-4a3c-a4ae-a27ad4902708" status: 200 len: 1493 microversion: 2.1 time: 0.177768 Apr 11 15:29:33 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 126/380] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:29:33 2023] GET /compute/v2.1/servers/e4555892-7abb-4a3c-a4ae-a27ad4902708 => generated 1493 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:29:34 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-e63fe311-8173-4103-8bcb-2f12a1a38a97 req-b1bf5cd9-8ae7-420f-8999-6cb4043f2020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c4329ae-07cb-4f28-9fd6-29b398517d2b", "name": "network-vif-plugged", "status": "completed", "tag": "37d248cb-99ae-4dcd-adfe-46bce9920d3e"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:29:34 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-e63fe311-8173-4103-8bcb-2f12a1a38a97 req-b1bf5cd9-8ae7-420f-8999-6cb4043f2020 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:34 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-e63fe311-8173-4103-8bcb-2f12a1a38a97 req-b1bf5cd9-8ae7-420f-8999-6cb4043f2020 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:34 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-e63fe311-8173-4103-8bcb-2f12a1a38a97 req-b1bf5cd9-8ae7-420f-8999-6cb4043f2020 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:34 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-e63fe311-8173-4103-8bcb-2f12a1a38a97 req-b1bf5cd9-8ae7-420f-8999-6cb4043f2020 service nova] Creating event network-vif-plugged:37d248cb-99ae-4dcd-adfe-46bce9920d3e for instance 7c4329ae-07cb-4f28-9fd6-29b398517d2b on user Apr 11 15:29:34 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-e63fe311-8173-4103-8bcb-2f12a1a38a97 req-b1bf5cd9-8ae7-420f-8999-6cb4043f2020 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030854 Apr 11 15:29:34 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 128/381] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:29:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:29:36 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-f237f52c-a0ca-414a-a59e-55fe4ec3df3e req-d563cf5d-71fb-4fc9-8fa8-8c4339e414f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d534d17d-ba77-4447-8a63-7d6021ad7896", "tag": "05f23fee-4450-48d6-8b2f-6c1fcf308da6"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:29:36 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-f237f52c-a0ca-414a-a59e-55fe4ec3df3e req-d563cf5d-71fb-4fc9-8fa8-8c4339e414f6 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:36 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-f237f52c-a0ca-414a-a59e-55fe4ec3df3e req-d563cf5d-71fb-4fc9-8fa8-8c4339e414f6 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:36 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-f237f52c-a0ca-414a-a59e-55fe4ec3df3e req-d563cf5d-71fb-4fc9-8fa8-8c4339e414f6 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:36 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-f237f52c-a0ca-414a-a59e-55fe4ec3df3e req-d563cf5d-71fb-4fc9-8fa8-8c4339e414f6 service nova] Creating event network-changed:05f23fee-4450-48d6-8b2f-6c1fcf308da6 for instance d534d17d-ba77-4447-8a63-7d6021ad7896 on user Apr 11 15:29:36 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-f237f52c-a0ca-414a-a59e-55fe4ec3df3e req-d563cf5d-71fb-4fc9-8fa8-8c4339e414f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043527 Apr 11 15:29:36 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 128/382] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:29:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:29:36 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "929df1ae-4b01-4bfb-aa54-9da994b764c5"}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:29:36 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:29:36 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:36 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:36 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:36 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:36 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:36 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:36 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.357280 Apr 11 15:29:36 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 127/383] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 15:29:36 2023] POST /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896/os-volume_attachments => generated 194 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:29:39 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:29:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-d3b029c7-b82f-415c-abb8-3f2c740c979f tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:29:39 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-d3b029c7-b82f-415c-abb8-3f2c740c979f tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:29:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d3b029c7-b82f-415c-abb8-3f2c740c979f tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d3b029c7-b82f-415c-abb8-3f2c740c979f tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d3b029c7-b82f-415c-abb8-3f2c740c979f tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d3b029c7-b82f-415c-abb8-3f2c740c979f tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d3b029c7-b82f-415c-abb8-3f2c740c979f tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d3b029c7-b82f-415c-abb8-3f2c740c979f tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:39 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-d3b029c7-b82f-415c-abb8-3f2c740c979f tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/os-volume_attachments/092c1963-af41-4f6f-9205-8970fc6e3122" status: 200 len: 194 microversion: 2.20 time: 0.154923 Apr 11 15:29:39 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 129/384] 10.0.0.210 () {64 vars in 1531 bytes} [Tue Apr 11 15:29:39 2023] GET /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/os-volume_attachments/092c1963-af41-4f6f-9205-8970fc6e3122 => generated 194 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 15:29:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:29:39 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:29:39 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:39 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:39 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:39 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:39 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:39 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:39 user devstack@n-api.service[61165]: DEBUG nova.objects.instance [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lazy-loading 'services' on Instance uuid 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d {{(pid=61165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 15:29:39 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/os-volume_attachments/092c1963-af41-4f6f-9205-8970fc6e3122" status: 202 len: 0 microversion: 2.20 time: 0.317477 Apr 11 15:29:39 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 129/385] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Apr 11 15:29:39 2023] DELETE /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/os-volume_attachments/092c1963-af41-4f6f-9205-8970fc6e3122 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:29:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-8f9447b2-bc0d-4e78-8320-121e4c7bbd96 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:29:39 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-8f9447b2-bc0d-4e78-8320-121e4c7bbd96 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:29:39 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:29:39 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:29:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8f9447b2-bc0d-4e78-8320-121e4c7bbd96 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8f9447b2-bc0d-4e78-8320-121e4c7bbd96 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8f9447b2-bc0d-4e78-8320-121e4c7bbd96 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8f9447b2-bc0d-4e78-8320-121e4c7bbd96 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8f9447b2-bc0d-4e78-8320-121e4c7bbd96 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8f9447b2-bc0d-4e78-8320-121e4c7bbd96 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:39 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-8f9447b2-bc0d-4e78-8320-121e4c7bbd96 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055717 Apr 11 15:29:39 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 128/386] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Apr 11 15:29:39 2023] GET /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 15:29:41 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-ff3514d8-7a87-42cf-9c11-b476395bacca tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:29:41 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-ff3514d8-7a87-42cf-9c11-b476395bacca tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:29:41 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ff3514d8-7a87-42cf-9c11-b476395bacca tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:41 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ff3514d8-7a87-42cf-9c11-b476395bacca tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:41 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ff3514d8-7a87-42cf-9c11-b476395bacca tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:41 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ff3514d8-7a87-42cf-9c11-b476395bacca tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:41 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ff3514d8-7a87-42cf-9c11-b476395bacca tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:41 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ff3514d8-7a87-42cf-9c11-b476395bacca tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:42 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-ff3514d8-7a87-42cf-9c11-b476395bacca tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:29:42 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-ff3514d8-7a87-42cf-9c11-b476395bacca tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35" status: 200 len: 1677 microversion: 2.1 time: 0.175865 Apr 11 15:29:42 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 130/387] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:29:41 2023] GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35 => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:29:42 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e168e446-1ecb-4f58-bc6c-0f488fa989a2"}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:29:42 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:29:42 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:42 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:42 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:42 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:42 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:42 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:42 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.327769 Apr 11 15:29:42 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 130/388] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 15:29:42 2023] POST /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:29:49 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:29:49 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:29:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:49 user devstack@n-api.service[61166]: DEBUG nova.objects.instance [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lazy-loading 'services' on Instance uuid d534d17d-ba77-4447-8a63-7d6021ad7896 {{(pid=61166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 15:29:49 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896/os-volume_attachments/929df1ae-4b01-4bfb-aa54-9da994b764c5" status: 202 len: 0 microversion: 2.1 time: 0.188495 Apr 11 15:29:49 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 129/389] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 15:29:49 2023] DELETE /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896/os-volume_attachments/929df1ae-4b01-4bfb-aa54-9da994b764c5 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:29:49 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-d6f3c7f1-dfea-4534-8b6f-3e80caa201b0 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:29:49 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-d6f3c7f1-dfea-4534-8b6f-3e80caa201b0 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:29:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d6f3c7f1-dfea-4534-8b6f-3e80caa201b0 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d6f3c7f1-dfea-4534-8b6f-3e80caa201b0 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d6f3c7f1-dfea-4534-8b6f-3e80caa201b0 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d6f3c7f1-dfea-4534-8b6f-3e80caa201b0 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d6f3c7f1-dfea-4534-8b6f-3e80caa201b0 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d6f3c7f1-dfea-4534-8b6f-3e80caa201b0 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:49 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-d6f3c7f1-dfea-4534-8b6f-3e80caa201b0 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055605 Apr 11 15:29:49 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 131/390] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:29:49 2023] GET /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:29:50 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:29:50 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:29:50 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:50 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:50 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:50 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:50 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:50 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:50 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:29:50 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Old instance type m1.nano, new instance type m1.micro {{(pid=61165) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 11 15:29:50 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:50 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:50 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:50 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:50 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:50 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:50 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Getting quotas for project bb7660e8f76b471487136806ee9eec62. Resources: {'cores', 'ram'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:29:50 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Getting quotas for user 10720df0ac4f4e62a0a5c9883d600add and project bb7660e8f76b471487136806ee9eec62. Resources: {'cores', 'ram'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:29:50 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Flavor limits 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:29:50 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Image limits 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:29:50 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Flavor pref 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:29:50 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Image pref 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:29:50 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:29:50 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35/action" status: 202 len: 0 microversion: 2.1 time: 0.437238 Apr 11 15:29:50 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 131/391] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 15:29:50 2023] POST /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35/action => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:29:50 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-96b4eb94-4e15-4bb7-9915-ead3a32fec13 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:29:50 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-96b4eb94-4e15-4bb7-9915-ead3a32fec13 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:29:50 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-96b4eb94-4e15-4bb7-9915-ead3a32fec13 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:50 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-96b4eb94-4e15-4bb7-9915-ead3a32fec13 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:50 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-96b4eb94-4e15-4bb7-9915-ead3a32fec13 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:50 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-96b4eb94-4e15-4bb7-9915-ead3a32fec13 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:50 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-96b4eb94-4e15-4bb7-9915-ead3a32fec13 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:50 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-96b4eb94-4e15-4bb7-9915-ead3a32fec13 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:50 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-96b4eb94-4e15-4bb7-9915-ead3a32fec13 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:29:50 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-96b4eb94-4e15-4bb7-9915-ead3a32fec13 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35" status: 200 len: 1732 microversion: 2.1 time: 0.181819 Apr 11 15:29:50 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 130/392] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:29:50 2023] GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35 => generated 1732 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:29:53 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-e05de44c-3fc2-4773-9b64-357a6f999571 req-9664d049-1699-498b-b2c9-98b22cd16dfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a805345-374c-4326-9e8f-39bfc7947a35", "name": "network-vif-unplugged", "status": "completed", "tag": "d8c64197-b034-4f38-821d-ba030f1fca6b"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:29:53 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-e05de44c-3fc2-4773-9b64-357a6f999571 req-9664d049-1699-498b-b2c9-98b22cd16dfb service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:53 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-e05de44c-3fc2-4773-9b64-357a6f999571 req-9664d049-1699-498b-b2c9-98b22cd16dfb service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:53 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-e05de44c-3fc2-4773-9b64-357a6f999571 req-9664d049-1699-498b-b2c9-98b22cd16dfb service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:53 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-e05de44c-3fc2-4773-9b64-357a6f999571 req-9664d049-1699-498b-b2c9-98b22cd16dfb service nova] Creating event network-vif-unplugged:d8c64197-b034-4f38-821d-ba030f1fca6b for instance 6a805345-374c-4326-9e8f-39bfc7947a35 on user Apr 11 15:29:53 user devstack@n-api.service[61167]: DEBUG nova.compute.api [req-e05de44c-3fc2-4773-9b64-357a6f999571 req-9664d049-1699-498b-b2c9-98b22cd16dfb service nova] Instance 6a805345-374c-4326-9e8f-39bfc7947a35 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 15:29:53 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-e05de44c-3fc2-4773-9b64-357a6f999571 req-9664d049-1699-498b-b2c9-98b22cd16dfb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050653 Apr 11 15:29:53 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 132/393] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:29:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:29:55 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-fd7699fe-6875-4503-8dcc-96411e640198 req-c172aa28-2126-430f-ab5f-6387a49a6818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a805345-374c-4326-9e8f-39bfc7947a35", "name": "network-vif-plugged", "status": "completed", "tag": "d8c64197-b034-4f38-821d-ba030f1fca6b"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:29:55 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=27 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:29:55 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-fd7699fe-6875-4503-8dcc-96411e640198 req-c172aa28-2126-430f-ab5f-6387a49a6818 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:29:55 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-fd7699fe-6875-4503-8dcc-96411e640198 req-c172aa28-2126-430f-ab5f-6387a49a6818 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:29:55 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-fd7699fe-6875-4503-8dcc-96411e640198 req-c172aa28-2126-430f-ab5f-6387a49a6818 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:29:55 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:29:55 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-fd7699fe-6875-4503-8dcc-96411e640198 req-c172aa28-2126-430f-ab5f-6387a49a6818 service nova] Creating event network-vif-plugged:d8c64197-b034-4f38-821d-ba030f1fca6b for instance 6a805345-374c-4326-9e8f-39bfc7947a35 on user Apr 11 15:29:55 user devstack@n-api.service[61165]: DEBUG nova.compute.api [req-fd7699fe-6875-4503-8dcc-96411e640198 req-c172aa28-2126-430f-ab5f-6387a49a6818 service nova] Instance 6a805345-374c-4326-9e8f-39bfc7947a35 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61165) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 15:29:55 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-fd7699fe-6875-4503-8dcc-96411e640198 req-c172aa28-2126-430f-ab5f-6387a49a6818 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052298 Apr 11 15:29:55 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 132/394] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:29:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:30:04 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-49d0135a-f02d-4a06-bb12-074f09e516da req-fa534f60-d009-419a-9d0f-83c567522062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a805345-374c-4326-9e8f-39bfc7947a35", "name": "network-vif-plugged", "status": "completed", "tag": "d8c64197-b034-4f38-821d-ba030f1fca6b"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:30:04 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:30:04 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:30:04 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-49d0135a-f02d-4a06-bb12-074f09e516da req-fa534f60-d009-419a-9d0f-83c567522062 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:04 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-49d0135a-f02d-4a06-bb12-074f09e516da req-fa534f60-d009-419a-9d0f-83c567522062 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:04 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-49d0135a-f02d-4a06-bb12-074f09e516da req-fa534f60-d009-419a-9d0f-83c567522062 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:04 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-49d0135a-f02d-4a06-bb12-074f09e516da req-fa534f60-d009-419a-9d0f-83c567522062 service nova] Creating event network-vif-plugged:d8c64197-b034-4f38-821d-ba030f1fca6b for instance 6a805345-374c-4326-9e8f-39bfc7947a35 on user Apr 11 15:30:04 user devstack@n-api.service[61166]: DEBUG nova.compute.api [req-49d0135a-f02d-4a06-bb12-074f09e516da req-fa534f60-d009-419a-9d0f-83c567522062 service nova] Instance 6a805345-374c-4326-9e8f-39bfc7947a35 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61166) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 15:30:04 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-49d0135a-f02d-4a06-bb12-074f09e516da req-fa534f60-d009-419a-9d0f-83c567522062 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061059 Apr 11 15:30:04 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 131/395] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:30:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:30:06 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=18 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:30:06 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=30 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:30:06 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-4f9070df-3c53-4169-ad33-db1854197e4b req-6b2913a8-8b74-4158-ac3f-40d60cac8033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a805345-374c-4326-9e8f-39bfc7947a35", "name": "network-vif-plugged", "status": "completed", "tag": "d8c64197-b034-4f38-821d-ba030f1fca6b"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:30:06 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-4f9070df-3c53-4169-ad33-db1854197e4b req-6b2913a8-8b74-4158-ac3f-40d60cac8033 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:06 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-4f9070df-3c53-4169-ad33-db1854197e4b req-6b2913a8-8b74-4158-ac3f-40d60cac8033 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:06 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-4f9070df-3c53-4169-ad33-db1854197e4b req-6b2913a8-8b74-4158-ac3f-40d60cac8033 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:06 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-4f9070df-3c53-4169-ad33-db1854197e4b req-6b2913a8-8b74-4158-ac3f-40d60cac8033 service nova] Creating event network-vif-plugged:d8c64197-b034-4f38-821d-ba030f1fca6b for instance 6a805345-374c-4326-9e8f-39bfc7947a35 on user Apr 11 15:30:06 user devstack@n-api.service[61167]: DEBUG nova.compute.api [req-4f9070df-3c53-4169-ad33-db1854197e4b req-6b2913a8-8b74-4158-ac3f-40d60cac8033 service nova] Instance 6a805345-374c-4326-9e8f-39bfc7947a35 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 15:30:06 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-4f9070df-3c53-4169-ad33-db1854197e4b req-6b2913a8-8b74-4158-ac3f-40d60cac8033 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064659 Apr 11 15:30:06 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 133/396] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:30:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:30:08 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=3 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:30:08 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:30:08 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=3 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:30:08 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-59b0f04a-2a76-43cd-aa6e-7ffe340b9bf9 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:30:08 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-59b0f04a-2a76-43cd-aa6e-7ffe340b9bf9 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:30:08 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-59b0f04a-2a76-43cd-aa6e-7ffe340b9bf9 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:08 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-59b0f04a-2a76-43cd-aa6e-7ffe340b9bf9 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:08 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-59b0f04a-2a76-43cd-aa6e-7ffe340b9bf9 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:08 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-59b0f04a-2a76-43cd-aa6e-7ffe340b9bf9 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:08 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-59b0f04a-2a76-43cd-aa6e-7ffe340b9bf9 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:08 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-59b0f04a-2a76-43cd-aa6e-7ffe340b9bf9 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:08 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-59b0f04a-2a76-43cd-aa6e-7ffe340b9bf9 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/os-interface" status: 200 len: 282 microversion: 2.49 time: 0.110444 Apr 11 15:30:08 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 133/397] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 15:30:08 2023] GET /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/os-interface => generated 282 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 15:30:09 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-46b28ea9-4245-4a89-9838-c956f5ec76d1 req-0993200c-53d5-44b0-a7f3-464989d1d31f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a", "tag": "40f1797d-278c-4676-8413-3b0c0f113dd9"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:30:09 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-46b28ea9-4245-4a89-9838-c956f5ec76d1 req-0993200c-53d5-44b0-a7f3-464989d1d31f service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:09 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-46b28ea9-4245-4a89-9838-c956f5ec76d1 req-0993200c-53d5-44b0-a7f3-464989d1d31f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:09 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-46b28ea9-4245-4a89-9838-c956f5ec76d1 req-0993200c-53d5-44b0-a7f3-464989d1d31f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:09 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-46b28ea9-4245-4a89-9838-c956f5ec76d1 req-0993200c-53d5-44b0-a7f3-464989d1d31f service nova] Creating event network-changed:40f1797d-278c-4676-8413-3b0c0f113dd9 for instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a on user Apr 11 15:30:09 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-46b28ea9-4245-4a89-9838-c956f5ec76d1 req-0993200c-53d5-44b0-a7f3-464989d1d31f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033401 Apr 11 15:30:09 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 132/398] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:30:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:30:09 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-95e0aea4-bf7f-42ef-9593-d92a47a6c51a tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:30:09 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-95e0aea4-bf7f-42ef-9593-d92a47a6c51a tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:30:09 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-95e0aea4-bf7f-42ef-9593-d92a47a6c51a tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:09 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-95e0aea4-bf7f-42ef-9593-d92a47a6c51a tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:09 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-95e0aea4-bf7f-42ef-9593-d92a47a6c51a tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:09 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-95e0aea4-bf7f-42ef-9593-d92a47a6c51a tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:09 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-95e0aea4-bf7f-42ef-9593-d92a47a6c51a tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:09 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-95e0aea4-bf7f-42ef-9593-d92a47a6c51a tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:09 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-95e0aea4-bf7f-42ef-9593-d92a47a6c51a tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32986358bcc4148ad3f361e3944ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dec4b679f24d1e85b1105b4849cddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:30:09 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-95e0aea4-bf7f-42ef-9593-d92a47a6c51a tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f32986358bcc4148ad3f361e3944ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dec4b679f24d1e85b1105b4849cddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:30:09 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-95e0aea4-bf7f-42ef-9593-d92a47a6c51a tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f32986358bcc4148ad3f361e3944ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dec4b679f24d1e85b1105b4849cddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:30:09 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-95e0aea4-bf7f-42ef-9593-d92a47a6c51a tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" status: 200 len: 1626 microversion: 2.49 time: 0.211792 Apr 11 15:30:09 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 134/399] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:30:09 2023] GET /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a => generated 1626 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:30:09 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "f07eb0b8-74da-402a-a601-68a72f85f931", "tag": "nic-tag"}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:30:09 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:30:09 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:09 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:09 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:09 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:09 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:09 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:11 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-7049d01f-aaa6-4b69-9c44-0bfb3cb4391e req-76d8d963-a30b-4509-9529-360cb0a4f0c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a", "tag": "d218dc4e-de80-49ed-be04-59771f71dd3f"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:30:11 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-7049d01f-aaa6-4b69-9c44-0bfb3cb4391e req-76d8d963-a30b-4509-9529-360cb0a4f0c2 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:11 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-7049d01f-aaa6-4b69-9c44-0bfb3cb4391e req-76d8d963-a30b-4509-9529-360cb0a4f0c2 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:11 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-7049d01f-aaa6-4b69-9c44-0bfb3cb4391e req-76d8d963-a30b-4509-9529-360cb0a4f0c2 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:11 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-7049d01f-aaa6-4b69-9c44-0bfb3cb4391e req-76d8d963-a30b-4509-9529-360cb0a4f0c2 service nova] Creating event network-changed:d218dc4e-de80-49ed-be04-59771f71dd3f for instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a on user Apr 11 15:30:11 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-7049d01f-aaa6-4b69-9c44-0bfb3cb4391e req-76d8d963-a30b-4509-9529-360cb0a4f0c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046167 Apr 11 15:30:11 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 133/400] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:30:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:30:13 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:30:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:13 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/os-interface" status: 200 len: 281 microversion: 2.49 time: 3.694558 Apr 11 15:30:13 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 134/401] 10.0.0.210 () {66 vars in 1414 bytes} [Tue Apr 11 15:30:09 2023] POST /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/os-interface => generated 281 bytes in 3698 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 15:30:13 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12415372-874e-4e85-8f69-e78ee88d4923", "tag": "volume-tag"}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:30:13 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:30:13 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:13 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:13 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:13 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:13 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:13 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:13 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.303600 Apr 11 15:30:13 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 135/402] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Apr 11 15:30:13 2023] POST /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 15:30:13 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-6d5358dc-593b-4392-a679-c99bd1e9275a req-c0504f61-ecfe-4a45-a1f7-f67ea6749c40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a", "name": "network-vif-plugged", "status": "completed", "tag": "d218dc4e-de80-49ed-be04-59771f71dd3f"}, {"server_uuid": "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a", "name": "network-vif-plugged", "status": "completed", "tag": "d218dc4e-de80-49ed-be04-59771f71dd3f"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:30:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-6d5358dc-593b-4392-a679-c99bd1e9275a req-c0504f61-ecfe-4a45-a1f7-f67ea6749c40 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-6d5358dc-593b-4392-a679-c99bd1e9275a req-c0504f61-ecfe-4a45-a1f7-f67ea6749c40 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-6d5358dc-593b-4392-a679-c99bd1e9275a req-c0504f61-ecfe-4a45-a1f7-f67ea6749c40 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:13 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-6d5358dc-593b-4392-a679-c99bd1e9275a req-c0504f61-ecfe-4a45-a1f7-f67ea6749c40 service nova] Creating event network-vif-plugged:d218dc4e-de80-49ed-be04-59771f71dd3f for instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a on user Apr 11 15:30:13 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-6d5358dc-593b-4392-a679-c99bd1e9275a req-c0504f61-ecfe-4a45-a1f7-f67ea6749c40 service nova] Creating event network-vif-plugged:d218dc4e-de80-49ed-be04-59771f71dd3f for instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a on user Apr 11 15:30:13 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-6d5358dc-593b-4392-a679-c99bd1e9275a req-c0504f61-ecfe-4a45-a1f7-f67ea6749c40 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032263 Apr 11 15:30:13 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 134/403] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:30:13 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:30:16 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:30:16 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:30:16 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-aee6ebe1-78ca-4fd8-9c43-749a9eac06b8 req-9a8cbee0-e032-43c2-b28b-28777c37b46d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39e3dfb1-bc09-474d-b8cb-f01b11923eae", "tag": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:30:16 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:16 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:16 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:16 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:16 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:16 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:16 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-aee6ebe1-78ca-4fd8-9c43-749a9eac06b8 req-9a8cbee0-e032-43c2-b28b-28777c37b46d service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:16 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-aee6ebe1-78ca-4fd8-9c43-749a9eac06b8 req-9a8cbee0-e032-43c2-b28b-28777c37b46d service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:16 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-aee6ebe1-78ca-4fd8-9c43-749a9eac06b8 req-9a8cbee0-e032-43c2-b28b-28777c37b46d service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:16 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-aee6ebe1-78ca-4fd8-9c43-749a9eac06b8 req-9a8cbee0-e032-43c2-b28b-28777c37b46d service nova] Creating event network-changed:21d628ba-6bae-4d98-94df-bb6fbb4f1c24 for instance 39e3dfb1-bc09-474d-b8cb-f01b11923eae on user Apr 11 15:30:16 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-aee6ebe1-78ca-4fd8-9c43-749a9eac06b8 req-9a8cbee0-e032-43c2-b28b-28777c37b46d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028942 Apr 11 15:30:16 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 136/404] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:30:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:30:16 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Going to try to terminate instance {{(pid=61165) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:30:16 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/39e3dfb1-bc09-474d-b8cb-f01b11923eae" status: 204 len: 0 microversion: 2.1 time: 0.117620 Apr 11 15:30:16 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 135/405] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:30:16 2023] DELETE /compute/v2.1/servers/39e3dfb1-bc09-474d-b8cb-f01b11923eae => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:30:16 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-0bdb1b9a-9bc0-4ec7-bfc5-073d178bc7a0 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:30:16 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-0bdb1b9a-9bc0-4ec7-bfc5-073d178bc7a0 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:30:16 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0bdb1b9a-9bc0-4ec7-bfc5-073d178bc7a0 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:16 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0bdb1b9a-9bc0-4ec7-bfc5-073d178bc7a0 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:16 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0bdb1b9a-9bc0-4ec7-bfc5-073d178bc7a0 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:16 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0bdb1b9a-9bc0-4ec7-bfc5-073d178bc7a0 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:16 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0bdb1b9a-9bc0-4ec7-bfc5-073d178bc7a0 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:16 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0bdb1b9a-9bc0-4ec7-bfc5-073d178bc7a0 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:16 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-0bdb1b9a-9bc0-4ec7-bfc5-073d178bc7a0 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e1716b2bb2438b93d46dc8052c788b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ed867a40534b70bf75dc0cc28fdfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:30:16 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-0bdb1b9a-9bc0-4ec7-bfc5-073d178bc7a0 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39e3dfb1-bc09-474d-b8cb-f01b11923eae" status: 200 len: 1560 microversion: 2.1 time: 0.280133 Apr 11 15:30:16 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 135/406] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:30:16 2023] GET /compute/v2.1/servers/39e3dfb1-bc09-474d-b8cb-f01b11923eae => generated 1560 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:30:16 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-bb4dd83e-4d18-498e-b6b3-56d5b068a43d req-d8ec68d6-0183-4e7f-9bab-7153fa3dd5df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e3dfb1-bc09-474d-b8cb-f01b11923eae", "name": "network-vif-unplugged", "status": "completed", "tag": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:30:16 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-bb4dd83e-4d18-498e-b6b3-56d5b068a43d req-d8ec68d6-0183-4e7f-9bab-7153fa3dd5df service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:16 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-bb4dd83e-4d18-498e-b6b3-56d5b068a43d req-d8ec68d6-0183-4e7f-9bab-7153fa3dd5df service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:16 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-bb4dd83e-4d18-498e-b6b3-56d5b068a43d req-d8ec68d6-0183-4e7f-9bab-7153fa3dd5df service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:16 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-bb4dd83e-4d18-498e-b6b3-56d5b068a43d req-d8ec68d6-0183-4e7f-9bab-7153fa3dd5df service nova] Creating event network-vif-unplugged:21d628ba-6bae-4d98-94df-bb6fbb4f1c24 for instance 39e3dfb1-bc09-474d-b8cb-f01b11923eae on user Apr 11 15:30:16 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-bb4dd83e-4d18-498e-b6b3-56d5b068a43d req-d8ec68d6-0183-4e7f-9bab-7153fa3dd5df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037606 Apr 11 15:30:16 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 137/407] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:30:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:30:17 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-ff54fbd0-674c-43d9-9062-7ac9f4b1a74d tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:30:17 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-ff54fbd0-674c-43d9-9062-7ac9f4b1a74d tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:30:17 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ff54fbd0-674c-43d9-9062-7ac9f4b1a74d tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:17 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ff54fbd0-674c-43d9-9062-7ac9f4b1a74d tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:17 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ff54fbd0-674c-43d9-9062-7ac9f4b1a74d tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:17 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ff54fbd0-674c-43d9-9062-7ac9f4b1a74d tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:17 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ff54fbd0-674c-43d9-9062-7ac9f4b1a74d tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:17 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ff54fbd0-674c-43d9-9062-7ac9f4b1a74d tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:17 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-ff54fbd0-674c-43d9-9062-7ac9f4b1a74d tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:30:17 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-ff54fbd0-674c-43d9-9062-7ac9f4b1a74d tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:30:17 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-ff54fbd0-674c-43d9-9062-7ac9f4b1a74d tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:30:17 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-ff54fbd0-674c-43d9-9062-7ac9f4b1a74d tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c4329ae-07cb-4f28-9fd6-29b398517d2b" status: 200 len: 1690 microversion: 2.87 time: 0.259925 Apr 11 15:30:17 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 136/408] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:30:17 2023] GET /compute/v2.1/servers/7c4329ae-07cb-4f28-9fd6-29b398517d2b => generated 1690 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:30:18 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-036c1593-9f48-48c8-8441-8e65c589447d req-2a4355b6-0675-42ae-98bd-68857d01d36d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e3dfb1-bc09-474d-b8cb-f01b11923eae", "name": "network-vif-deleted", "tag": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:30:18 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-036c1593-9f48-48c8-8441-8e65c589447d req-2a4355b6-0675-42ae-98bd-68857d01d36d service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:18 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-036c1593-9f48-48c8-8441-8e65c589447d req-2a4355b6-0675-42ae-98bd-68857d01d36d service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:18 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-036c1593-9f48-48c8-8441-8e65c589447d req-2a4355b6-0675-42ae-98bd-68857d01d36d service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:18 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-036c1593-9f48-48c8-8441-8e65c589447d req-2a4355b6-0675-42ae-98bd-68857d01d36d service nova] Creating event network-vif-deleted:21d628ba-6bae-4d98-94df-bb6fbb4f1c24 for instance 39e3dfb1-bc09-474d-b8cb-f01b11923eae on user Apr 11 15:30:18 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-036c1593-9f48-48c8-8441-8e65c589447d req-2a4355b6-0675-42ae-98bd-68857d01d36d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036429 Apr 11 15:30:18 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 136/409] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:30:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:30:18 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-42badac3-e057-4fe4-984c-452f66b21ce8 req-c78e9c51-e083-488d-9920-b96bfde972da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e3dfb1-bc09-474d-b8cb-f01b11923eae", "name": "network-vif-plugged", "status": "completed", "tag": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:30:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-42badac3-e057-4fe4-984c-452f66b21ce8 req-c78e9c51-e083-488d-9920-b96bfde972da service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-42badac3-e057-4fe4-984c-452f66b21ce8 req-c78e9c51-e083-488d-9920-b96bfde972da service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-42badac3-e057-4fe4-984c-452f66b21ce8 req-c78e9c51-e083-488d-9920-b96bfde972da service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:18 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-42badac3-e057-4fe4-984c-452f66b21ce8 req-c78e9c51-e083-488d-9920-b96bfde972da service nova] Creating event network-vif-plugged:21d628ba-6bae-4d98-94df-bb6fbb4f1c24 for instance 39e3dfb1-bc09-474d-b8cb-f01b11923eae on user Apr 11 15:30:18 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-42badac3-e057-4fe4-984c-452f66b21ce8 req-c78e9c51-e083-488d-9920-b96bfde972da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039576 Apr 11 15:30:18 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 138/410] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:30:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:30:20 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:30:20 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:30:20 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:20 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:20 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:20 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:20 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:20 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:20 user devstack@n-api.service[61165]: DEBUG nova.objects.instance [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lazy-loading 'services' on Instance uuid 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a {{(pid=61165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 15:30:20 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/os-volume_attachments/12415372-874e-4e85-8f69-e78ee88d4923" status: 202 len: 0 microversion: 2.49 time: 0.159082 Apr 11 15:30:20 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 137/411] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Apr 11 15:30:20 2023] DELETE /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/os-volume_attachments/12415372-874e-4e85-8f69-e78ee88d4923 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:30:22 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:30:22 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:30:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:22 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/os-interface/d218dc4e-de80-49ed-be04-59771f71dd3f" status: 202 len: 0 microversion: 2.49 time: 0.079571 Apr 11 15:30:22 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 137/412] 10.0.0.210 () {64 vars in 1507 bytes} [Tue Apr 11 15:30:22 2023] DELETE /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/os-interface/d218dc4e-de80-49ed-be04-59771f71dd3f => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:30:22 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-cdbf59aa-bb62-4312-8ac5-18b5cf454736 tempest-TaggedAttachmentsTest-931746229 tempest-TaggedAttachmentsTest-931746229-project-admin] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:30:22 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-cdbf59aa-bb62-4312-8ac5-18b5cf454736 tempest-TaggedAttachmentsTest-931746229 tempest-TaggedAttachmentsTest-931746229-project-admin] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:30:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-cdbf59aa-bb62-4312-8ac5-18b5cf454736 tempest-TaggedAttachmentsTest-931746229 tempest-TaggedAttachmentsTest-931746229-project-admin] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-cdbf59aa-bb62-4312-8ac5-18b5cf454736 tempest-TaggedAttachmentsTest-931746229 tempest-TaggedAttachmentsTest-931746229-project-admin] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-cdbf59aa-bb62-4312-8ac5-18b5cf454736 tempest-TaggedAttachmentsTest-931746229 tempest-TaggedAttachmentsTest-931746229-project-admin] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-cdbf59aa-bb62-4312-8ac5-18b5cf454736 tempest-TaggedAttachmentsTest-931746229 tempest-TaggedAttachmentsTest-931746229-project-admin] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-cdbf59aa-bb62-4312-8ac5-18b5cf454736 tempest-TaggedAttachmentsTest-931746229 tempest-TaggedAttachmentsTest-931746229-project-admin] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-cdbf59aa-bb62-4312-8ac5-18b5cf454736 tempest-TaggedAttachmentsTest-931746229 tempest-TaggedAttachmentsTest-931746229-project-admin] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:23 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-cdbf59aa-bb62-4312-8ac5-18b5cf454736 tempest-TaggedAttachmentsTest-931746229 tempest-TaggedAttachmentsTest-931746229-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/os-instance-actions/req-31d8da70-ae46-4555-bbe8-c514df73e54d" status: 200 len: 474 microversion: 2.49 time: 0.196296 Apr 11 15:30:23 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 139/413] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Apr 11 15:30:22 2023] GET /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/os-instance-actions/req-31d8da70-ae46-4555-bbe8-c514df73e54d => generated 474 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 15:30:23 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-99a65df5-0b32-485a-9394-b1c519fa8550 req-e25559d7-5fe3-419e-88da-f85a71fd7e37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a", "name": "network-vif-unplugged", "status": "completed", "tag": "d218dc4e-de80-49ed-be04-59771f71dd3f"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:30:23 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-99a65df5-0b32-485a-9394-b1c519fa8550 req-e25559d7-5fe3-419e-88da-f85a71fd7e37 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:23 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-99a65df5-0b32-485a-9394-b1c519fa8550 req-e25559d7-5fe3-419e-88da-f85a71fd7e37 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:23 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-99a65df5-0b32-485a-9394-b1c519fa8550 req-e25559d7-5fe3-419e-88da-f85a71fd7e37 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:23 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-99a65df5-0b32-485a-9394-b1c519fa8550 req-e25559d7-5fe3-419e-88da-f85a71fd7e37 service nova] Creating event network-vif-unplugged:d218dc4e-de80-49ed-be04-59771f71dd3f for instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a on user Apr 11 15:30:23 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-99a65df5-0b32-485a-9394-b1c519fa8550 req-e25559d7-5fe3-419e-88da-f85a71fd7e37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031965 Apr 11 15:30:23 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 138/414] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:30:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:30:25 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-40a027ef-602c-47ae-9be9-e129fb63b4e8 req-5add56db-f835-4c3f-bab8-d149567fd945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a", "name": "network-vif-plugged", "status": "completed", "tag": "d218dc4e-de80-49ed-be04-59771f71dd3f"}, {"server_uuid": "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a", "name": "network-vif-deleted", "tag": "d218dc4e-de80-49ed-be04-59771f71dd3f"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:30:25 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-40a027ef-602c-47ae-9be9-e129fb63b4e8 req-5add56db-f835-4c3f-bab8-d149567fd945 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:25 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-40a027ef-602c-47ae-9be9-e129fb63b4e8 req-5add56db-f835-4c3f-bab8-d149567fd945 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:25 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-40a027ef-602c-47ae-9be9-e129fb63b4e8 req-5add56db-f835-4c3f-bab8-d149567fd945 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:25 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-40a027ef-602c-47ae-9be9-e129fb63b4e8 req-5add56db-f835-4c3f-bab8-d149567fd945 service nova] Creating event network-vif-plugged:d218dc4e-de80-49ed-be04-59771f71dd3f for instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a on user Apr 11 15:30:25 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-40a027ef-602c-47ae-9be9-e129fb63b4e8 req-5add56db-f835-4c3f-bab8-d149567fd945 service nova] Creating event network-vif-deleted:d218dc4e-de80-49ed-be04-59771f71dd3f for instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a on user Apr 11 15:30:25 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-40a027ef-602c-47ae-9be9-e129fb63b4e8 req-5add56db-f835-4c3f-bab8-d149567fd945 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031285 Apr 11 15:30:25 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 138/415] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:30:25 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:30:29 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-1b08a712-2046-4951-aadb-6c84e3fa23c3 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:30:29 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-1b08a712-2046-4951-aadb-6c84e3fa23c3 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:30:29 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1b08a712-2046-4951-aadb-6c84e3fa23c3 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:29 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1b08a712-2046-4951-aadb-6c84e3fa23c3 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:29 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1b08a712-2046-4951-aadb-6c84e3fa23c3 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:29 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1b08a712-2046-4951-aadb-6c84e3fa23c3 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:29 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1b08a712-2046-4951-aadb-6c84e3fa23c3 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:29 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1b08a712-2046-4951-aadb-6c84e3fa23c3 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:29 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-1b08a712-2046-4951-aadb-6c84e3fa23c3 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041394 Apr 11 15:30:29 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 140/416] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Apr 11 15:30:29 2023] GET /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:30:29 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:30:29 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:30:29 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:29 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:29 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:29 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:29 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:29 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:29 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Going to try to terminate instance {{(pid=61165) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:30:29 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" status: 204 len: 0 microversion: 2.20 time: 0.132648 Apr 11 15:30:29 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 139/417] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 15:30:29 2023] DELETE /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 15:30:29 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-531999ba-79cd-4e53-8e40-ec548bcc601e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:30:29 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-531999ba-79cd-4e53-8e40-ec548bcc601e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:30:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-531999ba-79cd-4e53-8e40-ec548bcc601e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-531999ba-79cd-4e53-8e40-ec548bcc601e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-531999ba-79cd-4e53-8e40-ec548bcc601e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-531999ba-79cd-4e53-8e40-ec548bcc601e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-531999ba-79cd-4e53-8e40-ec548bcc601e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-531999ba-79cd-4e53-8e40-ec548bcc601e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:30 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-531999ba-79cd-4e53-8e40-ec548bcc601e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:30:30 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-531999ba-79cd-4e53-8e40-ec548bcc601e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:30:30 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-531999ba-79cd-4e53-8e40-ec548bcc601e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:30:30 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-531999ba-79cd-4e53-8e40-ec548bcc601e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" status: 200 len: 1712 microversion: 2.20 time: 0.183379 Apr 11 15:30:30 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 139/418] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:30:29 2023] GET /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d => generated 1712 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:30:30 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-269c9c4f-0344-4916-a37d-d62cbc3601e7 req-9cef155b-2c48-44cf-b6d3-3193244a2c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d", "name": "network-vif-unplugged", "status": "completed", "tag": "1ad8234a-3f96-43a0-9dea-862e6efcda73"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:30:30 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-269c9c4f-0344-4916-a37d-d62cbc3601e7 req-9cef155b-2c48-44cf-b6d3-3193244a2c51 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:30 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-269c9c4f-0344-4916-a37d-d62cbc3601e7 req-9cef155b-2c48-44cf-b6d3-3193244a2c51 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:30 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-269c9c4f-0344-4916-a37d-d62cbc3601e7 req-9cef155b-2c48-44cf-b6d3-3193244a2c51 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:30 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-269c9c4f-0344-4916-a37d-d62cbc3601e7 req-9cef155b-2c48-44cf-b6d3-3193244a2c51 service nova] Creating event network-vif-unplugged:1ad8234a-3f96-43a0-9dea-862e6efcda73 for instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d on user Apr 11 15:30:30 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-269c9c4f-0344-4916-a37d-d62cbc3601e7 req-9cef155b-2c48-44cf-b6d3-3193244a2c51 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035351 Apr 11 15:30:30 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 141/419] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:30:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:30:31 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-76f87090-93d6-4753-816e-605db6ad6aa1 req-fecaecd5-b404-4f28-806b-5fb3707537ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d", "name": "network-vif-deleted", "tag": "1ad8234a-3f96-43a0-9dea-862e6efcda73"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:30:31 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-76f87090-93d6-4753-816e-605db6ad6aa1 req-fecaecd5-b404-4f28-806b-5fb3707537ed service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:31 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-76f87090-93d6-4753-816e-605db6ad6aa1 req-fecaecd5-b404-4f28-806b-5fb3707537ed service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:31 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-76f87090-93d6-4753-816e-605db6ad6aa1 req-fecaecd5-b404-4f28-806b-5fb3707537ed service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:31 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-76f87090-93d6-4753-816e-605db6ad6aa1 req-fecaecd5-b404-4f28-806b-5fb3707537ed service nova] Creating event network-vif-deleted:1ad8234a-3f96-43a0-9dea-862e6efcda73 for instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d on user Apr 11 15:30:31 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-76f87090-93d6-4753-816e-605db6ad6aa1 req-fecaecd5-b404-4f28-806b-5fb3707537ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035314 Apr 11 15:30:31 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 140/420] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:30:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:30:32 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d", "name": "network-vif-plugged", "status": "completed", "tag": "1ad8234a-3f96-43a0-9dea-862e6efcda73"}, {"server_uuid": "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d", "name": "network-vif-plugged", "status": "completed", "tag": "1ad8234a-3f96-43a0-9dea-862e6efcda73"}, {"server_uuid": "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d", "name": "network-vif-plugged", "status": "completed", "tag": "1ad8234a-3f96-43a0-9dea-862e6efcda73"}, {"server_uuid": "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d", "name": "network-vif-unplugged", "status": "completed", "tag": "1ad8234a-3f96-43a0-9dea-862e6efcda73"}, {"server_uuid": "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d", "name": "network-vif-plugged", "status": "completed", "tag": "1ad8234a-3f96-43a0-9dea-862e6efcda73"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:30:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:32 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] Creating event network-vif-plugged:1ad8234a-3f96-43a0-9dea-862e6efcda73 for instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d on user Apr 11 15:30:32 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] Creating event network-vif-plugged:1ad8234a-3f96-43a0-9dea-862e6efcda73 for instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d on user Apr 11 15:30:32 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] Creating event network-vif-plugged:1ad8234a-3f96-43a0-9dea-862e6efcda73 for instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d on user Apr 11 15:30:32 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] Creating event network-vif-unplugged:1ad8234a-3f96-43a0-9dea-862e6efcda73 for instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d on user Apr 11 15:30:32 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] Creating event network-vif-plugged:1ad8234a-3f96-43a0-9dea-862e6efcda73 for instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d on user Apr 11 15:30:32 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.034348 Apr 11 15:30:32 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 140/421] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:30:32 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:30:35 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-1dcae14e-d0a8-4b5b-b957-7aa9b973641a tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1015387628", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "0c15a787-a267-421c-847b-fd92a49c18d5", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "f9b1d398-27cb-42de-9d95-0e031b1bd6ec"}]}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:30:35 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-1dcae14e-d0a8-4b5b-b957-7aa9b973641a tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] HTTP exception thrown: Block Device 0c15a787-a267-421c-847b-fd92a49c18d5 is not bootable. Apr 11 15:30:35 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-1dcae14e-d0a8-4b5b-b957-7aa9b973641a tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Request method failure captured: Apr 11 15:30:35 user devstack@n-api.service[61167]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 11 15:30:35 user devstack@n-api.service[61167]: Accept: application/json Apr 11 15:30:35 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 15:30:35 user devstack@n-api.service[61167]: Connection: close Apr 11 15:30:35 user devstack@n-api.service[61167]: Content-Length: 357 Apr 11 15:30:35 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 15:30:35 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 15:30:35 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 15:30:35 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 15:30:35 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNXvMrH6hVnA2_xtO12AnSS5L7tEtwltB42V7STqsPFkX1siG8cfx_r3xlA_cAVKU27_eB9mKFYmGM82hgnKgyfM_OCR91O4dZnnWcDasgDkQQ-8ZcPNgPDHtZ3233inf1KKXEOG3V3YOkacFYgC3v5ZLP-n8TcnC_TXgpNqxxNh7uAA Apr 11 15:30:35 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 15:30:35 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 15:30:35 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 15:30:35 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 15:30:35 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 15:30:35 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 15:30:35 user devstack@n-api.service[61167]: X-Project-Id: 561130d089c8415297697bcedc93aefc Apr 11 15:30:35 user devstack@n-api.service[61167]: X-Project-Name: tempest-ServersNegativeTestJSON-1004375615 Apr 11 15:30:35 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 15:30:35 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 15:30:35 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/561130d089c8415297697bcedc93aefc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/561130d089c8415297697bcedc93aefc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/561130d089c8415297697bcedc93aefc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:30:35 user devstack@n-api.service[61167]: X-Tenant: tempest-ServersNegativeTestJSON-1004375615 Apr 11 15:30:35 user devstack@n-api.service[61167]: X-Tenant-Id: 561130d089c8415297697bcedc93aefc Apr 11 15:30:35 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1004375615 Apr 11 15:30:35 user devstack@n-api.service[61167]: X-User: tempest-ServersNegativeTestJSON-1004375615-project-member Apr 11 15:30:35 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 15:30:35 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 15:30:35 user devstack@n-api.service[61167]: X-User-Id: b2538af5c739404aa433b766976e5b2d Apr 11 15:30:35 user devstack@n-api.service[61167]: X-User-Name: tempest-ServersNegativeTestJSON-1004375615-project-member Apr 11 15:30:35 user devstack@n-api.service[61167]: Apr 11 15:30:35 user devstack@n-api.service[61167]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1015387628", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "0c15a787-a267-421c-847b-fd92a49c18d5", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "f9b1d398-27cb-42de-9d95-0e031b1bd6ec"}]}} Apr 11 15:30:35 user devstack@n-api.service[61167]: method: > Apr 11 15:30:35 user devstack@n-api.service[61167]: exception: Block Device 0c15a787-a267-421c-847b-fd92a49c18d5 is not bootable. Apr 11 15:30:35 user devstack@n-api.service[61167]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1015387628', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '0c15a787-a267-421c-847b-fd92a49c18d5'}], 'networks': [{'uuid': 'f9b1d398-27cb-42de-9d95-0e031b1bd6ec'}]}}} Apr 11 15:30:35 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 0c15a787-a267-421c-847b-fd92a49c18d5 is not bootable. Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 0c15a787-a267-421c-847b-fd92a49c18d5 is not bootable. Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 0c15a787-a267-421c-847b-fd92a49c18d5 is not bootable. Apr 11 15:30:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:30:35 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-1dcae14e-d0a8-4b5b-b957-7aa9b973641a tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Returning 400 to user: Block Device 0c15a787-a267-421c-847b-fd92a49c18d5 is not bootable. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:30:35 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-1dcae14e-d0a8-4b5b-b957-7aa9b973641a tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.078322 Apr 11 15:30:35 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 142/422] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 15:30:35 2023] POST /compute/v2.1/servers => generated 110 bytes in 80 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 15:30:35 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-d2db1055-0bdd-45ba-bfb5-715e009a0af2 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:30:35 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-d2db1055-0bdd-45ba-bfb5-715e009a0af2 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:30:35 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d2db1055-0bdd-45ba-bfb5-715e009a0af2 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:35 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d2db1055-0bdd-45ba-bfb5-715e009a0af2 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:35 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d2db1055-0bdd-45ba-bfb5-715e009a0af2 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:35 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d2db1055-0bdd-45ba-bfb5-715e009a0af2 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:35 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d2db1055-0bdd-45ba-bfb5-715e009a0af2 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:35 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d2db1055-0bdd-45ba-bfb5-715e009a0af2 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:35 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-d2db1055-0bdd-45ba-bfb5-715e009a0af2 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2538af5c739404aa433b766976e5b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561130d089c8415297697bcedc93aefc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:30:35 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-d2db1055-0bdd-45ba-bfb5-715e009a0af2 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4555892-7abb-4a3c-a4ae-a27ad4902708" status: 200 len: 1493 microversion: 2.1 time: 0.141831 Apr 11 15:30:35 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 141/423] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:30:35 2023] GET /compute/v2.1/servers/e4555892-7abb-4a3c-a4ae-a27ad4902708 => generated 1493 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:30:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-3224409a-9d5e-4f44-a858-d5194dd43213 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:30:39 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-3224409a-9d5e-4f44-a858-d5194dd43213 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:30:39 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=21 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:30:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3224409a-9d5e-4f44-a858-d5194dd43213 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3224409a-9d5e-4f44-a858-d5194dd43213 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3224409a-9d5e-4f44-a858-d5194dd43213 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3224409a-9d5e-4f44-a858-d5194dd43213 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3224409a-9d5e-4f44-a858-d5194dd43213 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3224409a-9d5e-4f44-a858-d5194dd43213 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:39 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=34,nova_cell1:INSERT=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:30:39 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-3224409a-9d5e-4f44-a858-d5194dd43213 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058285 Apr 11 15:30:39 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 141/424] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:30:39 2023] GET /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 15:30:40 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:30:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-e143db2c-2509-4ec2-bac7-d07e713d0739 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:30:40 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-e143db2c-2509-4ec2-bac7-d07e713d0739 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:30:40 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=21 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:30:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e143db2c-2509-4ec2-bac7-d07e713d0739 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e143db2c-2509-4ec2-bac7-d07e713d0739 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e143db2c-2509-4ec2-bac7-d07e713d0739 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e143db2c-2509-4ec2-bac7-d07e713d0739 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e143db2c-2509-4ec2-bac7-d07e713d0739 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e143db2c-2509-4ec2-bac7-d07e713d0739 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:40 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-e143db2c-2509-4ec2-bac7-d07e713d0739 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:30:40 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-e143db2c-2509-4ec2-bac7-d07e713d0739 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35" status: 200 len: 1731 microversion: 2.1 time: 0.157173 Apr 11 15:30:40 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 143/425] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:30:40 2023] GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:30:41 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97b66671-5188-4023-ba8c-6eaf24dae749"}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:30:41 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:30:41 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:30:41 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:41 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:41 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:41 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:41 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:41 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:41 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:30:41 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304911 Apr 11 15:30:41 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 142/426] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 15:30:41 2023] POST /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:30:48 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:30:48 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:30:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:48 user devstack@n-api.service[61166]: DEBUG nova.objects.instance [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lazy-loading 'services' on Instance uuid d534d17d-ba77-4447-8a63-7d6021ad7896 {{(pid=61166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 15:30:48 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896/os-volume_attachments/97b66671-5188-4023-ba8c-6eaf24dae749" status: 202 len: 0 microversion: 2.1 time: 0.276541 Apr 11 15:30:48 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 142/427] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 15:30:48 2023] DELETE /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896/os-volume_attachments/97b66671-5188-4023-ba8c-6eaf24dae749 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:30:48 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-759aea1d-e4d3-467f-ad4a-29bcaf8e467f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:30:48 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-759aea1d-e4d3-467f-ad4a-29bcaf8e467f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:30:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-759aea1d-e4d3-467f-ad4a-29bcaf8e467f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-759aea1d-e4d3-467f-ad4a-29bcaf8e467f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-759aea1d-e4d3-467f-ad4a-29bcaf8e467f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-759aea1d-e4d3-467f-ad4a-29bcaf8e467f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:30:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-759aea1d-e4d3-467f-ad4a-29bcaf8e467f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:30:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-759aea1d-e4d3-467f-ad4a-29bcaf8e467f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:30:48 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-759aea1d-e4d3-467f-ad4a-29bcaf8e467f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049510 Apr 11 15:30:48 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 144/428] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:30:48 2023] GET /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:31:06 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:31:06 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:31:06 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-5864c7c4-c3d6-46d8-872b-1285f5a96912 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:31:06 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-5864c7c4-c3d6-46d8-872b-1285f5a96912 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:31:06 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5864c7c4-c3d6-46d8-872b-1285f5a96912 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:06 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5864c7c4-c3d6-46d8-872b-1285f5a96912 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:06 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5864c7c4-c3d6-46d8-872b-1285f5a96912 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:06 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5864c7c4-c3d6-46d8-872b-1285f5a96912 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:06 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5864c7c4-c3d6-46d8-872b-1285f5a96912 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:06 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5864c7c4-c3d6-46d8-872b-1285f5a96912 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:06 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-5864c7c4-c3d6-46d8-872b-1285f5a96912 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] HTTP exception thrown: Instance 39e3dfb1-bc09-474d-b8cb-f01b11923eae could not be found. Apr 11 15:31:06 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-5864c7c4-c3d6-46d8-872b-1285f5a96912 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Request method failure captured: Apr 11 15:31:06 user devstack@n-api.service[61165]: request: GET /compute/v2.1/servers/39e3dfb1-bc09-474d-b8cb-f01b11923eae HTTP/1.1 Apr 11 15:31:06 user devstack@n-api.service[61165]: Accept: application/json Apr 11 15:31:06 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 15:31:06 user devstack@n-api.service[61165]: Connection: close Apr 11 15:31:06 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 15:31:06 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 15:31:06 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 15:31:06 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 15:31:06 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 15:31:06 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNXuu_KztT2_zE6TQbheDJAKwPEOUm9FGhAHPgfLhVxXEXed-Dsw6KblbjYcTrFLKvX9Su7rXTbSZ-9RAh0q4zTt1KuPlKgF5L3oB4whBdjWsPxvFe6beWtZd3bu8FDVPN007iV4assbHDUPSv3ocZGRRy0lDYrw3yZtW35pnAhFTh5Q Apr 11 15:31:06 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 15:31:06 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 15:31:06 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 15:31:06 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 15:31:06 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 15:31:06 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 15:31:06 user devstack@n-api.service[61165]: X-Project-Id: 63ed867a40534b70bf75dc0cc28fdfec Apr 11 15:31:06 user devstack@n-api.service[61165]: X-Project-Name: tempest-TestShelveInstance-602339736 Apr 11 15:31:06 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 15:31:06 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 15:31:06 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/63ed867a40534b70bf75dc0cc28fdfec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/63ed867a40534b70bf75dc0cc28fdfec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/63ed867a40534b70bf75dc0cc28fdfec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:31:06 user devstack@n-api.service[61165]: X-Tenant: tempest-TestShelveInstance-602339736 Apr 11 15:31:06 user devstack@n-api.service[61165]: X-Tenant-Id: 63ed867a40534b70bf75dc0cc28fdfec Apr 11 15:31:06 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-TestShelveInstance-602339736 Apr 11 15:31:06 user devstack@n-api.service[61165]: X-User: tempest-TestShelveInstance-602339736-project-member Apr 11 15:31:06 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 15:31:06 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 15:31:06 user devstack@n-api.service[61165]: X-User-Id: 49e1716b2bb2438b93d46dc8052c788b Apr 11 15:31:06 user devstack@n-api.service[61165]: X-User-Name: tempest-TestShelveInstance-602339736-project-member Apr 11 15:31:06 user devstack@n-api.service[61165]: method: > Apr 11 15:31:06 user devstack@n-api.service[61165]: exception: Instance 39e3dfb1-bc09-474d-b8cb-f01b11923eae could not be found. Apr 11 15:31:06 user devstack@n-api.service[61165]: action_args: {'id': '39e3dfb1-bc09-474d-b8cb-f01b11923eae'} Apr 11 15:31:06 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39e3dfb1-bc09-474d-b8cb-f01b11923eae could not be found. Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39e3dfb1-bc09-474d-b8cb-f01b11923eae could not be found. Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39e3dfb1-bc09-474d-b8cb-f01b11923eae could not be found. Apr 11 15:31:06 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:31:06 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-5864c7c4-c3d6-46d8-872b-1285f5a96912 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Returning 404 to user: Instance 39e3dfb1-bc09-474d-b8cb-f01b11923eae could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:31:06 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-5864c7c4-c3d6-46d8-872b-1285f5a96912 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39e3dfb1-bc09-474d-b8cb-f01b11923eae" status: 404 len: 111 microversion: 2.1 time: 0.039727 Apr 11 15:31:06 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 143/429] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:31:06 2023] GET /compute/v2.1/servers/39e3dfb1-bc09-474d-b8cb-f01b11923eae => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:31:06 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=3 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:31:06 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=14,nova_cell1:INSERT=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:31:06 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-71193f1c-919d-4b1a-8650-6e9acaf550d1 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Calling method '.version_select at 0x7f4c2edf65f0>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:31:06 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-71193f1c-919d-4b1a-8650-6e9acaf550d1 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1630475072" status: 202 len: 0 microversion: 2.1 time: 0.037724 Apr 11 15:31:06 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 143/430] 10.0.0.210 () {62 vars in 1331 bytes} [Tue Apr 11 15:31:06 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1630475072 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:31:13 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-01bbdddf-476d-4e5d-a041-feb344eedb0d tempest-TaggedAttachmentsTest-931746229 tempest-TaggedAttachmentsTest-931746229-project-admin] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:31:13 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-01bbdddf-476d-4e5d-a041-feb344eedb0d tempest-TaggedAttachmentsTest-931746229 tempest-TaggedAttachmentsTest-931746229-project-admin] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:31:13 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=3 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:31:13 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=12 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:31:13 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-01bbdddf-476d-4e5d-a041-feb344eedb0d tempest-TaggedAttachmentsTest-931746229 tempest-TaggedAttachmentsTest-931746229-project-admin] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:13 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-01bbdddf-476d-4e5d-a041-feb344eedb0d tempest-TaggedAttachmentsTest-931746229 tempest-TaggedAttachmentsTest-931746229-project-admin] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:13 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-01bbdddf-476d-4e5d-a041-feb344eedb0d tempest-TaggedAttachmentsTest-931746229 tempest-TaggedAttachmentsTest-931746229-project-admin] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:13 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-01bbdddf-476d-4e5d-a041-feb344eedb0d tempest-TaggedAttachmentsTest-931746229 tempest-TaggedAttachmentsTest-931746229-project-admin] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:13 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-01bbdddf-476d-4e5d-a041-feb344eedb0d tempest-TaggedAttachmentsTest-931746229 tempest-TaggedAttachmentsTest-931746229-project-admin] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:13 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-01bbdddf-476d-4e5d-a041-feb344eedb0d tempest-TaggedAttachmentsTest-931746229 tempest-TaggedAttachmentsTest-931746229-project-admin] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:13 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-01bbdddf-476d-4e5d-a041-feb344eedb0d tempest-TaggedAttachmentsTest-931746229 tempest-TaggedAttachmentsTest-931746229-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/os-instance-actions/req-31d8da70-ae46-4555-bbe8-c514df73e54d" status: 200 len: 503 microversion: 2.49 time: 0.046451 Apr 11 15:31:13 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 145/431] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Apr 11 15:31:13 2023] GET /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/os-instance-actions/req-31d8da70-ae46-4555-bbe8-c514df73e54d => generated 503 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 15:31:13 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-b0c47326-d64d-412c-8ba3-d9122170a87d tempest-TaggedAttachmentsTest-931746229 tempest-TaggedAttachmentsTest-931746229-project-admin] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:31:13 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-b0c47326-d64d-412c-8ba3-d9122170a87d tempest-TaggedAttachmentsTest-931746229 tempest-TaggedAttachmentsTest-931746229-project-admin] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:31:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b0c47326-d64d-412c-8ba3-d9122170a87d tempest-TaggedAttachmentsTest-931746229 tempest-TaggedAttachmentsTest-931746229-project-admin] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b0c47326-d64d-412c-8ba3-d9122170a87d tempest-TaggedAttachmentsTest-931746229 tempest-TaggedAttachmentsTest-931746229-project-admin] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b0c47326-d64d-412c-8ba3-d9122170a87d tempest-TaggedAttachmentsTest-931746229 tempest-TaggedAttachmentsTest-931746229-project-admin] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b0c47326-d64d-412c-8ba3-d9122170a87d tempest-TaggedAttachmentsTest-931746229 tempest-TaggedAttachmentsTest-931746229-project-admin] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b0c47326-d64d-412c-8ba3-d9122170a87d tempest-TaggedAttachmentsTest-931746229 tempest-TaggedAttachmentsTest-931746229-project-admin] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b0c47326-d64d-412c-8ba3-d9122170a87d tempest-TaggedAttachmentsTest-931746229 tempest-TaggedAttachmentsTest-931746229-project-admin] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:13 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-b0c47326-d64d-412c-8ba3-d9122170a87d tempest-TaggedAttachmentsTest-931746229 tempest-TaggedAttachmentsTest-931746229-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/os-instance-actions/req-31d8da70-ae46-4555-bbe8-c514df73e54d" status: 200 len: 503 microversion: 2.49 time: 0.090123 Apr 11 15:31:13 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 144/432] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Apr 11 15:31:13 2023] GET /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/os-instance-actions/req-31d8da70-ae46-4555-bbe8-c514df73e54d => generated 503 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 15:31:13 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-cb25a4a2-b4ea-44db-a0c7-6c72fa35cd34 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:31:13 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-cb25a4a2-b4ea-44db-a0c7-6c72fa35cd34 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:31:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-cb25a4a2-b4ea-44db-a0c7-6c72fa35cd34 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-cb25a4a2-b4ea-44db-a0c7-6c72fa35cd34 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-cb25a4a2-b4ea-44db-a0c7-6c72fa35cd34 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-cb25a4a2-b4ea-44db-a0c7-6c72fa35cd34 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-cb25a4a2-b4ea-44db-a0c7-6c72fa35cd34 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-cb25a4a2-b4ea-44db-a0c7-6c72fa35cd34 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:13 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-cb25a4a2-b4ea-44db-a0c7-6c72fa35cd34 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.047662 Apr 11 15:31:13 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 144/433] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Apr 11 15:31:13 2023] GET /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:31:13 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:31:13 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:31:13 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:13 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:13 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:13 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:13 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:13 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:13 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Going to try to terminate instance {{(pid=61167) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:31:13 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" status: 204 len: 0 microversion: 2.49 time: 0.117498 Apr 11 15:31:13 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 146/434] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 15:31:13 2023] DELETE /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 15:31:13 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-578aeaf3-d93a-4c67-a202-f196a9a13560 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:31:13 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-578aeaf3-d93a-4c67-a202-f196a9a13560 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:31:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-578aeaf3-d93a-4c67-a202-f196a9a13560 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-578aeaf3-d93a-4c67-a202-f196a9a13560 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-578aeaf3-d93a-4c67-a202-f196a9a13560 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-578aeaf3-d93a-4c67-a202-f196a9a13560 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-578aeaf3-d93a-4c67-a202-f196a9a13560 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-578aeaf3-d93a-4c67-a202-f196a9a13560 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:13 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-29bbd806-9920-46c6-992a-52a51615d2e9 req-c9fb219b-234f-4051-972c-445c69212283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a", "name": "network-vif-unplugged", "status": "completed", "tag": "40f1797d-278c-4676-8413-3b0c0f113dd9"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:31:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-29bbd806-9920-46c6-992a-52a51615d2e9 req-c9fb219b-234f-4051-972c-445c69212283 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-29bbd806-9920-46c6-992a-52a51615d2e9 req-c9fb219b-234f-4051-972c-445c69212283 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-29bbd806-9920-46c6-992a-52a51615d2e9 req-c9fb219b-234f-4051-972c-445c69212283 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:13 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-29bbd806-9920-46c6-992a-52a51615d2e9 req-c9fb219b-234f-4051-972c-445c69212283 service nova] Creating event network-vif-unplugged:40f1797d-278c-4676-8413-3b0c0f113dd9 for instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a on user Apr 11 15:31:13 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-29bbd806-9920-46c6-992a-52a51615d2e9 req-c9fb219b-234f-4051-972c-445c69212283 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028739 Apr 11 15:31:13 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 145/435] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:31:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:31:13 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-578aeaf3-d93a-4c67-a202-f196a9a13560 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32986358bcc4148ad3f361e3944ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dec4b679f24d1e85b1105b4849cddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:31:13 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-578aeaf3-d93a-4c67-a202-f196a9a13560 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f32986358bcc4148ad3f361e3944ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dec4b679f24d1e85b1105b4849cddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:31:13 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-578aeaf3-d93a-4c67-a202-f196a9a13560 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f32986358bcc4148ad3f361e3944ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dec4b679f24d1e85b1105b4849cddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:31:13 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-578aeaf3-d93a-4c67-a202-f196a9a13560 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" status: 200 len: 1750 microversion: 2.49 time: 0.453716 Apr 11 15:31:13 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 145/436] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:31:13 2023] GET /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a => generated 1750 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 15:31:15 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-d05737fe-cede-4711-9fd0-5ce3f651f9c2 req-d957adad-cb94-4390-8a1d-f0035c96414d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a", "name": "network-vif-deleted", "tag": "40f1797d-278c-4676-8413-3b0c0f113dd9"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:31:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-d05737fe-cede-4711-9fd0-5ce3f651f9c2 req-d957adad-cb94-4390-8a1d-f0035c96414d service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-d05737fe-cede-4711-9fd0-5ce3f651f9c2 req-d957adad-cb94-4390-8a1d-f0035c96414d service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-d05737fe-cede-4711-9fd0-5ce3f651f9c2 req-d957adad-cb94-4390-8a1d-f0035c96414d service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:15 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-d05737fe-cede-4711-9fd0-5ce3f651f9c2 req-d957adad-cb94-4390-8a1d-f0035c96414d service nova] Creating event network-vif-deleted:40f1797d-278c-4676-8413-3b0c0f113dd9 for instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a on user Apr 11 15:31:15 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-d05737fe-cede-4711-9fd0-5ce3f651f9c2 req-d957adad-cb94-4390-8a1d-f0035c96414d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085582 Apr 11 15:31:15 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 147/437] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:31:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:31:15 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-920e4c32-4d72-4756-a68a-e64abd2040dc req-6f67f7a8-7106-4d9f-814d-c9b3bd59bdd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a", "name": "network-vif-plugged", "status": "completed", "tag": "40f1797d-278c-4676-8413-3b0c0f113dd9"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:31:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-920e4c32-4d72-4756-a68a-e64abd2040dc req-6f67f7a8-7106-4d9f-814d-c9b3bd59bdd2 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-920e4c32-4d72-4756-a68a-e64abd2040dc req-6f67f7a8-7106-4d9f-814d-c9b3bd59bdd2 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-920e4c32-4d72-4756-a68a-e64abd2040dc req-6f67f7a8-7106-4d9f-814d-c9b3bd59bdd2 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:15 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-920e4c32-4d72-4756-a68a-e64abd2040dc req-6f67f7a8-7106-4d9f-814d-c9b3bd59bdd2 service nova] Creating event network-vif-plugged:40f1797d-278c-4676-8413-3b0c0f113dd9 for instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a on user Apr 11 15:31:15 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-920e4c32-4d72-4756-a68a-e64abd2040dc req-6f67f7a8-7106-4d9f-814d-c9b3bd59bdd2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031391 Apr 11 15:31:15 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 146/438] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:31:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:31:17 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-c064bc88-d768-44cd-8046-4a3e7a777df5 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-318219810"}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:31:17 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-c064bc88-d768-44cd-8046-4a3e7a777df5 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:31:17 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c064bc88-d768-44cd-8046-4a3e7a777df5 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:17 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c064bc88-d768-44cd-8046-4a3e7a777df5 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:17 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c064bc88-d768-44cd-8046-4a3e7a777df5 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:17 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c064bc88-d768-44cd-8046-4a3e7a777df5 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:17 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c064bc88-d768-44cd-8046-4a3e7a777df5 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:17 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c064bc88-d768-44cd-8046-4a3e7a777df5 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:18 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-c064bc88-d768-44cd-8046-4a3e7a777df5 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7c4329ae-07cb-4f28-9fd6-29b398517d2b/action" status: 202 len: 52 microversion: 2.87 time: 0.758286 Apr 11 15:31:18 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 146/439] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 15:31:17 2023] POST /compute/v2.1/servers/7c4329ae-07cb-4f28-9fd6-29b398517d2b/action => generated 52 bytes in 760 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 11 15:31:20 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-5a395783-6f46-449f-b927-10a0d632d831 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:31:20 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-5a395783-6f46-449f-b927-10a0d632d831 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:31:20 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-5a395783-6f46-449f-b927-10a0d632d831 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:20 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-5a395783-6f46-449f-b927-10a0d632d831 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:20 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-5a395783-6f46-449f-b927-10a0d632d831 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:20 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-5a395783-6f46-449f-b927-10a0d632d831 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:20 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-5a395783-6f46-449f-b927-10a0d632d831 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:20 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-5a395783-6f46-449f-b927-10a0d632d831 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:20 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-5a395783-6f46-449f-b927-10a0d632d831 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] HTTP exception thrown: Instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d could not be found. Apr 11 15:31:20 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-5a395783-6f46-449f-b927-10a0d632d831 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Request method failure captured: Apr 11 15:31:20 user devstack@n-api.service[61167]: request: GET /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d HTTP/1.1 Apr 11 15:31:20 user devstack@n-api.service[61167]: Accept: application/json Apr 11 15:31:20 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 15:31:20 user devstack@n-api.service[61167]: Connection: close Apr 11 15:31:20 user devstack@n-api.service[61167]: Content-Length: 0 Apr 11 15:31:20 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 15:31:20 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 15:31:20 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 15:31:20 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 15:31:20 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNXuRmukKFdyrff1cZpmSI5bUhJleAnLM1D6Veg4YggW5e9xf0q2Ms-3mHIpTMhRbxwJ-IsunSj7_ute5ZXoB-lKpxSwMLxkdEgp7mv1pZCD1_2C24WRu1XrtwW5HoEw3OUXrYDgD7os6ju5cll5jYJdSTBnwAsWwVbB4wJ4Gg83eo5w Apr 11 15:31:20 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 15:31:20 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 15:31:20 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 15:31:20 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 15:31:20 user devstack@n-api.service[61167]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 15:31:20 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 15:31:20 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 15:31:20 user devstack@n-api.service[61167]: X-Project-Id: 63b9b79fb98441fd9f1b5df54471f0bd Apr 11 15:31:20 user devstack@n-api.service[61167]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1785499036 Apr 11 15:31:20 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 15:31:20 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 15:31:20 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/63b9b79fb98441fd9f1b5df54471f0bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/63b9b79fb98441fd9f1b5df54471f0bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/63b9b79fb98441fd9f1b5df54471f0bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:31:20 user devstack@n-api.service[61167]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1785499036 Apr 11 15:31:20 user devstack@n-api.service[61167]: X-Tenant-Id: 63b9b79fb98441fd9f1b5df54471f0bd Apr 11 15:31:20 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1785499036 Apr 11 15:31:20 user devstack@n-api.service[61167]: X-User: tempest-AttachVolumeShelveTestJSON-1785499036-project-member Apr 11 15:31:20 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 15:31:20 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 15:31:20 user devstack@n-api.service[61167]: X-User-Id: 88d988d9ce0a41669b7c487ac07b4cfe Apr 11 15:31:20 user devstack@n-api.service[61167]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1785499036-project-member Apr 11 15:31:20 user devstack@n-api.service[61167]: method: > Apr 11 15:31:20 user devstack@n-api.service[61167]: exception: Instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d could not be found. Apr 11 15:31:20 user devstack@n-api.service[61167]: action_args: {'id': '1e01618b-2aa4-4b56-b1a2-0d6e25e3075d'} Apr 11 15:31:20 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d could not be found. Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d could not be found. Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d could not be found. Apr 11 15:31:20 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:31:20 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-5a395783-6f46-449f-b927-10a0d632d831 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Returning 404 to user: Instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d could not be found. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:31:20 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-5a395783-6f46-449f-b927-10a0d632d831 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" status: 404 len: 111 microversion: 2.20 time: 0.035293 Apr 11 15:31:20 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 148/440] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:31:20 2023] GET /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 15:31:20 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-5ce431a8-4fa0-40aa-95b1-9b273b939c33 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '.version_select at 0x7f4c2ed75f30>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:31:20 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-5ce431a8-4fa0-40aa-95b1-9b273b939c33 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2006224467" status: 204 len: 0 microversion: 2.20 time: 0.084473 Apr 11 15:31:20 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 147/441] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Apr 11 15:31:20 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2006224467 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 15:31:21 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-c14a2c81-9f6d-49bf-b7a6-3992fcbeadd4 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Action: 'create', calling method: .version_select at 0x7f4c2ec56170>, body: {"keypair": {"name": "tempest-keypair-1917410281", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYrUwvaqlHN87/1coexF5rSHRlGXUa9nMDtkuMig5cppT2KcjZ1/LzgWVf5StAo8KnqLK68JMRfWhU47MCnTdmCe53lfYleLEedLL3gnNiTy7iFFgo0q1LydREc5eKJzQ=="}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:31:21 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-c14a2c81-9f6d-49bf-b7a6-3992fcbeadd4 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Getting quotas for project 63b9b79fb98441fd9f1b5df54471f0bd. Resources: {'key_pairs'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:31:21 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-c14a2c81-9f6d-49bf-b7a6-3992fcbeadd4 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Getting quotas for user 88d988d9ce0a41669b7c487ac07b4cfe and project 63b9b79fb98441fd9f1b5df54471f0bd. Resources: {'key_pairs'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:31:21 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-c14a2c81-9f6d-49bf-b7a6-3992fcbeadd4 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.152927 Apr 11 15:31:21 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 147/442] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 15:31:21 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 154 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 15:31:24 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1714025063", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "15a1a586-0100-4057-8501-5c5a282d4063"}], "security_groups": [{"name": "tempest-securitygroup--1179338652"}], "key_name": "tempest-keypair-1917410281", "user_data": "}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:31:24 user devstack@n-api.service[61167]: DEBUG nova.network.neutron [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] validate_networks() for [('15a1a586-0100-4057-8501-5c5a282d4063', None, None, None, None, None)] {{(pid=61167) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:31:24 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Flavor limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:31:24 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Image limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:31:24 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Flavor pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:31:24 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Image pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:31:24 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:31:24 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-1e901328-aa1f-4b9d-bfc8-7bbb3fe6a907 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:31:24 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-1e901328-aa1f-4b9d-bfc8-7bbb3fe6a907 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:31:24 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:24 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:24 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1e901328-aa1f-4b9d-bfc8-7bbb3fe6a907 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:24 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1e901328-aa1f-4b9d-bfc8-7bbb3fe6a907 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:24 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1e901328-aa1f-4b9d-bfc8-7bbb3fe6a907 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:24 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1e901328-aa1f-4b9d-bfc8-7bbb3fe6a907 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1e901328-aa1f-4b9d-bfc8-7bbb3fe6a907 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1e901328-aa1f-4b9d-bfc8-7bbb3fe6a907 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:24 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Getting quotas for project 63b9b79fb98441fd9f1b5df54471f0bd. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:31:24 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Getting quotas for user 88d988d9ce0a41669b7c487ac07b4cfe and project 63b9b79fb98441fd9f1b5df54471f0bd. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:31:24 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Going to run 1 instances... {{(pid=61167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:31:24 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52fe638c-5ada-47d5-b376-233bfa808a37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:31:24 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.737450 Apr 11 15:31:24 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 149/443] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 15:31:24 2023] POST /compute/v2.1/servers => generated 400 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 15:31:24 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-382f3c52-8f00-4546-9b84-533ff87858ca tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:31:24 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-382f3c52-8f00-4546-9b84-533ff87858ca tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:31:25 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-1e901328-aa1f-4b9d-bfc8-7bbb3fe6a907 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:31:25 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-1e901328-aa1f-4b9d-bfc8-7bbb3fe6a907 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:31:25 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-1e901328-aa1f-4b9d-bfc8-7bbb3fe6a907 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:31:25 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-1e901328-aa1f-4b9d-bfc8-7bbb3fe6a907 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c4329ae-07cb-4f28-9fd6-29b398517d2b" status: 200 len: 1690 microversion: 2.87 time: 0.177740 Apr 11 15:31:25 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 148/444] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:31:24 2023] GET /compute/v2.1/servers/7c4329ae-07cb-4f28-9fd6-29b398517d2b => generated 1690 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:31:25 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-382f3c52-8f00-4546-9b84-533ff87858ca tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:31:25 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-382f3c52-8f00-4546-9b84-533ff87858ca tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:31:25 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-382f3c52-8f00-4546-9b84-533ff87858ca tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:31:25 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-382f3c52-8f00-4546-9b84-533ff87858ca tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59" status: 200 len: 1276 microversion: 2.20 time: 0.078320 Apr 11 15:31:25 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 148/445] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:31:24 2023] GET /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59 => generated 1276 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:31:27 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-23b29f8b-9e03-4e9c-982f-f09f393f46fb req-cf57247b-1e28-4904-b470-6bf3a19bdf32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffc25fc1-e59f-42c8-a371-b4b12e17fd59", "tag": "3ae0cd28-c459-47b7-be17-133b69773f9c"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:31:27 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-23b29f8b-9e03-4e9c-982f-f09f393f46fb req-cf57247b-1e28-4904-b470-6bf3a19bdf32 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:27 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-23b29f8b-9e03-4e9c-982f-f09f393f46fb req-cf57247b-1e28-4904-b470-6bf3a19bdf32 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:27 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-23b29f8b-9e03-4e9c-982f-f09f393f46fb req-cf57247b-1e28-4904-b470-6bf3a19bdf32 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:27 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-23b29f8b-9e03-4e9c-982f-f09f393f46fb req-cf57247b-1e28-4904-b470-6bf3a19bdf32 service nova] Creating event network-changed:3ae0cd28-c459-47b7-be17-133b69773f9c for instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 on user Apr 11 15:31:27 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-23b29f8b-9e03-4e9c-982f-f09f393f46fb req-cf57247b-1e28-4904-b470-6bf3a19bdf32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046324 Apr 11 15:31:27 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 150/446] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:31:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:31:28 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-23226259-c970-4b00-b4a3-247e0faa2c5a tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Action: 'create', calling method: .version_select at 0x7f4c2ed39b40>, body: {"keypair": {"name": "tempest-TestStampPattern-416277054", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3FSQFz663lRbqzNxmPBbu9uJ3msIEfoeqvzCwilWtgPX+8lEdFmI1HaDVmQnOzGM0qsSCbXPgFMVYIHe6QVLQ+qXsBEhvf3WHKTsTkVBdGgOn/xo5dIBdvrA6jCgt/VA=="}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:31:28 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-23226259-c970-4b00-b4a3-247e0faa2c5a tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Getting quotas for project f0f7abe5e3144c7ab354ffaba1748616. Resources: {'key_pairs'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:31:28 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-23226259-c970-4b00-b4a3-247e0faa2c5a tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Getting quotas for user 402ec212c8a64a559f82c166070a92ef and project f0f7abe5e3144c7ab354ffaba1748616. Resources: {'key_pairs'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:31:28 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-23226259-c970-4b00-b4a3-247e0faa2c5a tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.147946 Apr 11 15:31:28 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 149/447] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 15:31:28 2023] POST /compute/v2.1/os-keypairs => generated 394 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:31:30 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-47e59145-e7c6-43eb-ae1b-83f60884677b req-fe36e992-4c34-4589-a001-b813758301eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc25fc1-e59f-42c8-a371-b4b12e17fd59", "name": "network-vif-plugged", "status": "completed", "tag": "3ae0cd28-c459-47b7-be17-133b69773f9c"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:31:30 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:31:30 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-47e59145-e7c6-43eb-ae1b-83f60884677b req-fe36e992-4c34-4589-a001-b813758301eb service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:30 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-47e59145-e7c6-43eb-ae1b-83f60884677b req-fe36e992-4c34-4589-a001-b813758301eb service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:30 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-47e59145-e7c6-43eb-ae1b-83f60884677b req-fe36e992-4c34-4589-a001-b813758301eb service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:30 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-47e59145-e7c6-43eb-ae1b-83f60884677b req-fe36e992-4c34-4589-a001-b813758301eb service nova] Creating event network-vif-plugged:3ae0cd28-c459-47b7-be17-133b69773f9c for instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 on user Apr 11 15:31:30 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-47e59145-e7c6-43eb-ae1b-83f60884677b req-fe36e992-4c34-4589-a001-b813758301eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034338 Apr 11 15:31:30 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 149/448] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:31:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:31:31 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1021680630", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "key_name": "tempest-TestStampPattern-416277054", "security_groups": [{"name": "tempest-secgroup-smoke-411530607"}], "networks": [{"uuid": "8dd93667-4f8b-4d89-b7be-056f5f39bffe"}]}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:31:31 user devstack@n-api.service[61167]: DEBUG nova.network.neutron [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] validate_networks() for [('8dd93667-4f8b-4d89-b7be-056f5f39bffe', None, None, None, None, None)] {{(pid=61167) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:31:32 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Flavor limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:31:32 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Image limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:31:32 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Flavor pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:31:32 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Image pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:31:32 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:31:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:32 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Getting quotas for project f0f7abe5e3144c7ab354ffaba1748616. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:31:32 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Getting quotas for user 402ec212c8a64a559f82c166070a92ef and project f0f7abe5e3144c7ab354ffaba1748616. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:31:32 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Going to run 1 instances... {{(pid=61167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:31:32 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52fe638c-5ada-47d5-b376-233bfa808a37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:31:32 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-a45569cd-3d9b-40e7-8bbb-7b6c3db3ede1 req-175b69c9-1aab-4b15-bbf7-fb71ad230c9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc25fc1-e59f-42c8-a371-b4b12e17fd59", "name": "network-vif-plugged", "status": "completed", "tag": "3ae0cd28-c459-47b7-be17-133b69773f9c"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:31:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-a45569cd-3d9b-40e7-8bbb-7b6c3db3ede1 req-175b69c9-1aab-4b15-bbf7-fb71ad230c9f service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-a45569cd-3d9b-40e7-8bbb-7b6c3db3ede1 req-175b69c9-1aab-4b15-bbf7-fb71ad230c9f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-a45569cd-3d9b-40e7-8bbb-7b6c3db3ede1 req-175b69c9-1aab-4b15-bbf7-fb71ad230c9f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:32 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.576621 Apr 11 15:31:32 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 151/449] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 15:31:31 2023] POST /compute/v2.1/servers => generated 403 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 15:31:32 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-a45569cd-3d9b-40e7-8bbb-7b6c3db3ede1 req-175b69c9-1aab-4b15-bbf7-fb71ad230c9f service nova] Creating event network-vif-plugged:3ae0cd28-c459-47b7-be17-133b69773f9c for instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 on user Apr 11 15:31:32 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-976f4f1c-c6ef-497c-818b-aed3e6738d4a tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:31:32 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-976f4f1c-c6ef-497c-818b-aed3e6738d4a tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:31:32 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-a45569cd-3d9b-40e7-8bbb-7b6c3db3ede1 req-175b69c9-1aab-4b15-bbf7-fb71ad230c9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040545 Apr 11 15:31:32 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 150/450] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:31:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:31:32 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-976f4f1c-c6ef-497c-818b-aed3e6738d4a tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402ec212c8a64a559f82c166070a92ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f7abe5e3144c7ab354ffaba1748616', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:31:32 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-976f4f1c-c6ef-497c-818b-aed3e6738d4a tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85658a44-9ff2-4553-b9fd-686bf35fd6ec" status: 200 len: 1236 microversion: 2.1 time: 0.062885 Apr 11 15:31:32 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 150/451] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:31:32 2023] GET /compute/v2.1/servers/85658a44-9ff2-4553-b9fd-686bf35fd6ec => generated 1236 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:31:34 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-cf3e5d76-8c1e-4881-afcf-b0858bafd89c req-2cd5a019-6707-4223-b9ee-7dc3e8d7453b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85658a44-9ff2-4553-b9fd-686bf35fd6ec", "tag": "c6826c01-eadd-49db-a842-accd25f7534a"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:31:34 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-cf3e5d76-8c1e-4881-afcf-b0858bafd89c req-2cd5a019-6707-4223-b9ee-7dc3e8d7453b service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:34 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-cf3e5d76-8c1e-4881-afcf-b0858bafd89c req-2cd5a019-6707-4223-b9ee-7dc3e8d7453b service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:34 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-cf3e5d76-8c1e-4881-afcf-b0858bafd89c req-2cd5a019-6707-4223-b9ee-7dc3e8d7453b service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:34 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-cf3e5d76-8c1e-4881-afcf-b0858bafd89c req-2cd5a019-6707-4223-b9ee-7dc3e8d7453b service nova] Creating event network-changed:c6826c01-eadd-49db-a842-accd25f7534a for instance 85658a44-9ff2-4553-b9fd-686bf35fd6ec on user Apr 11 15:31:34 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-cf3e5d76-8c1e-4881-afcf-b0858bafd89c req-2cd5a019-6707-4223-b9ee-7dc3e8d7453b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031126 Apr 11 15:31:34 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 152/452] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:31:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:31:35 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-0b8e3d76-aa9b-497f-a2b0-49635ef503ae tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:31:35 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-0b8e3d76-aa9b-497f-a2b0-49635ef503ae tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:31:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0b8e3d76-aa9b-497f-a2b0-49635ef503ae tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0b8e3d76-aa9b-497f-a2b0-49635ef503ae tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0b8e3d76-aa9b-497f-a2b0-49635ef503ae tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0b8e3d76-aa9b-497f-a2b0-49635ef503ae tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0b8e3d76-aa9b-497f-a2b0-49635ef503ae tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0b8e3d76-aa9b-497f-a2b0-49635ef503ae tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:36 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-0b8e3d76-aa9b-497f-a2b0-49635ef503ae tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2538af5c739404aa433b766976e5b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561130d089c8415297697bcedc93aefc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:31:36 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-0b8e3d76-aa9b-497f-a2b0-49635ef503ae tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4555892-7abb-4a3c-a4ae-a27ad4902708" status: 200 len: 1493 microversion: 2.1 time: 0.154588 Apr 11 15:31:36 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 151/453] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:31:35 2023] GET /compute/v2.1/servers/e4555892-7abb-4a3c-a4ae-a27ad4902708 => generated 1493 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:31:37 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-93b1e75f-fdb5-4dce-b085-e6de18afa18a req-e0ccf3c8-6e2c-41e3-b22d-5409734d82cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85658a44-9ff2-4553-b9fd-686bf35fd6ec", "name": "network-vif-plugged", "status": "completed", "tag": "c6826c01-eadd-49db-a842-accd25f7534a"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:31:37 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:31:37 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-93b1e75f-fdb5-4dce-b085-e6de18afa18a req-e0ccf3c8-6e2c-41e3-b22d-5409734d82cd service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:37 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-93b1e75f-fdb5-4dce-b085-e6de18afa18a req-e0ccf3c8-6e2c-41e3-b22d-5409734d82cd service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:37 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-93b1e75f-fdb5-4dce-b085-e6de18afa18a req-e0ccf3c8-6e2c-41e3-b22d-5409734d82cd service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:37 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-93b1e75f-fdb5-4dce-b085-e6de18afa18a req-e0ccf3c8-6e2c-41e3-b22d-5409734d82cd service nova] Creating event network-vif-plugged:c6826c01-eadd-49db-a842-accd25f7534a for instance 85658a44-9ff2-4553-b9fd-686bf35fd6ec on user Apr 11 15:31:37 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-93b1e75f-fdb5-4dce-b085-e6de18afa18a req-e0ccf3c8-6e2c-41e3-b22d-5409734d82cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113112 Apr 11 15:31:37 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 151/454] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:31:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:31:38 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-88122cce-17e1-4218-b111-106316722846 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:31:38 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-88122cce-17e1-4218-b111-106316722846 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:31:38 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-88122cce-17e1-4218-b111-106316722846 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:38 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-88122cce-17e1-4218-b111-106316722846 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:38 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-88122cce-17e1-4218-b111-106316722846 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:38 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-88122cce-17e1-4218-b111-106316722846 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:38 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-88122cce-17e1-4218-b111-106316722846 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:38 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-88122cce-17e1-4218-b111-106316722846 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:39 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-88122cce-17e1-4218-b111-106316722846 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075698 Apr 11 15:31:39 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 153/455] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:31:38 2023] GET /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 15:31:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-64a8335b-e332-4fc0-b97d-70cad9b25640 req-3a884793-15c0-4298-9167-5555484166f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85658a44-9ff2-4553-b9fd-686bf35fd6ec", "name": "network-vif-plugged", "status": "completed", "tag": "c6826c01-eadd-49db-a842-accd25f7534a"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:31:39 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:31:39 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:31:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-64a8335b-e332-4fc0-b97d-70cad9b25640 req-3a884793-15c0-4298-9167-5555484166f4 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-64a8335b-e332-4fc0-b97d-70cad9b25640 req-3a884793-15c0-4298-9167-5555484166f4 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-64a8335b-e332-4fc0-b97d-70cad9b25640 req-3a884793-15c0-4298-9167-5555484166f4 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:39 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=25 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:31:39 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-64a8335b-e332-4fc0-b97d-70cad9b25640 req-3a884793-15c0-4298-9167-5555484166f4 service nova] Creating event network-vif-plugged:c6826c01-eadd-49db-a842-accd25f7534a for instance 85658a44-9ff2-4553-b9fd-686bf35fd6ec on user Apr 11 15:31:39 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-64a8335b-e332-4fc0-b97d-70cad9b25640 req-3a884793-15c0-4298-9167-5555484166f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039572 Apr 11 15:31:39 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 152/456] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:31:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:31:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ae53f4f-5bc4-4664-9ff6-3388782704ad"}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:31:40 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:31:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:40 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284126 Apr 11 15:31:40 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 152/457] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 15:31:40 2023] POST /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:31:41 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:31:41 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:31:41 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:41 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:41 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:41 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:41 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:41 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:41 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35/action" status: 202 len: 0 microversion: 2.1 time: 0.160147 Apr 11 15:31:41 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 154/458] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 15:31:41 2023] POST /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:31:41 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-04c9f094-bfb4-40d3-8bab-24f4ee968667 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:31:41 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-04c9f094-bfb4-40d3-8bab-24f4ee968667 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:31:41 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-04c9f094-bfb4-40d3-8bab-24f4ee968667 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:41 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-04c9f094-bfb4-40d3-8bab-24f4ee968667 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:41 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-04c9f094-bfb4-40d3-8bab-24f4ee968667 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:41 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-04c9f094-bfb4-40d3-8bab-24f4ee968667 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:41 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-04c9f094-bfb4-40d3-8bab-24f4ee968667 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:41 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-04c9f094-bfb4-40d3-8bab-24f4ee968667 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:41 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-04c9f094-bfb4-40d3-8bab-24f4ee968667 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:31:41 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-04c9f094-bfb4-40d3-8bab-24f4ee968667 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35" status: 200 len: 1730 microversion: 2.1 time: 0.325886 Apr 11 15:31:41 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 153/459] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:31:41 2023] GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35 => generated 1730 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:31:42 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=8 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:31:42 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-78bac180-347c-4d69-a2ce-1efe8d282050 req-2759cb5b-8685-472f-8595-d4f77299b36e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a805345-374c-4326-9e8f-39bfc7947a35", "name": "network-vif-unplugged", "status": "completed", "tag": "d8c64197-b034-4f38-821d-ba030f1fca6b"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:31:42 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-78bac180-347c-4d69-a2ce-1efe8d282050 req-2759cb5b-8685-472f-8595-d4f77299b36e service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:42 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-78bac180-347c-4d69-a2ce-1efe8d282050 req-2759cb5b-8685-472f-8595-d4f77299b36e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:42 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-78bac180-347c-4d69-a2ce-1efe8d282050 req-2759cb5b-8685-472f-8595-d4f77299b36e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:42 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-78bac180-347c-4d69-a2ce-1efe8d282050 req-2759cb5b-8685-472f-8595-d4f77299b36e service nova] Creating event network-vif-unplugged:d8c64197-b034-4f38-821d-ba030f1fca6b for instance 6a805345-374c-4326-9e8f-39bfc7947a35 on user Apr 11 15:31:42 user devstack@n-api.service[61165]: DEBUG nova.compute.api [req-78bac180-347c-4d69-a2ce-1efe8d282050 req-2759cb5b-8685-472f-8595-d4f77299b36e service nova] Instance 6a805345-374c-4326-9e8f-39bfc7947a35 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61165) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 15:31:42 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-78bac180-347c-4d69-a2ce-1efe8d282050 req-2759cb5b-8685-472f-8595-d4f77299b36e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.154172 Apr 11 15:31:42 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 153/460] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:31:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:31:44 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=4 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:31:44 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=12 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:31:44 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-5e6322d3-9b5b-4e45-8580-2d5454ad1c75 req-2cc14b69-435b-496f-b30a-f6638d408e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a805345-374c-4326-9e8f-39bfc7947a35", "name": "network-vif-plugged", "status": "completed", "tag": "d8c64197-b034-4f38-821d-ba030f1fca6b"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:31:44 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:31:45 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-5e6322d3-9b5b-4e45-8580-2d5454ad1c75 req-2cc14b69-435b-496f-b30a-f6638d408e11 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:45 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-5e6322d3-9b5b-4e45-8580-2d5454ad1c75 req-2cc14b69-435b-496f-b30a-f6638d408e11 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:45 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-5e6322d3-9b5b-4e45-8580-2d5454ad1c75 req-2cc14b69-435b-496f-b30a-f6638d408e11 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:45 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:31:45 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-5e6322d3-9b5b-4e45-8580-2d5454ad1c75 req-2cc14b69-435b-496f-b30a-f6638d408e11 service nova] Creating event network-vif-plugged:d8c64197-b034-4f38-821d-ba030f1fca6b for instance 6a805345-374c-4326-9e8f-39bfc7947a35 on user Apr 11 15:31:45 user devstack@n-api.service[61167]: DEBUG nova.compute.api [req-5e6322d3-9b5b-4e45-8580-2d5454ad1c75 req-2cc14b69-435b-496f-b30a-f6638d408e11 service nova] Instance 6a805345-374c-4326-9e8f-39bfc7947a35 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 15:31:45 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-5e6322d3-9b5b-4e45-8580-2d5454ad1c75 req-2cc14b69-435b-496f-b30a-f6638d408e11 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044902 Apr 11 15:31:45 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 155/461] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:31:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:31:48 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:31:48 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:31:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:49 user devstack@n-api.service[61166]: DEBUG nova.objects.instance [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lazy-loading 'services' on Instance uuid d534d17d-ba77-4447-8a63-7d6021ad7896 {{(pid=61166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 15:31:49 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896/os-volume_attachments/2ae53f4f-5bc4-4664-9ff6-3388782704ad" status: 202 len: 0 microversion: 2.1 time: 0.301210 Apr 11 15:31:49 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 154/462] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 15:31:48 2023] DELETE /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896/os-volume_attachments/2ae53f4f-5bc4-4664-9ff6-3388782704ad => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:31:49 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-2758bf8a-f9f0-4b4b-aef8-230f0a7ae5ed tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:31:49 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-2758bf8a-f9f0-4b4b-aef8-230f0a7ae5ed tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:31:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-2758bf8a-f9f0-4b4b-aef8-230f0a7ae5ed tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-2758bf8a-f9f0-4b4b-aef8-230f0a7ae5ed tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-2758bf8a-f9f0-4b4b-aef8-230f0a7ae5ed tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-2758bf8a-f9f0-4b4b-aef8-230f0a7ae5ed tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-2758bf8a-f9f0-4b4b-aef8-230f0a7ae5ed tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-2758bf8a-f9f0-4b4b-aef8-230f0a7ae5ed tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:49 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-2758bf8a-f9f0-4b4b-aef8-230f0a7ae5ed tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043770 Apr 11 15:31:49 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 154/463] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:31:49 2023] GET /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:31:53 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-c9e62e4d-846e-4a00-9448-326324e9ff1c req-af48035e-e04f-4e41-884a-0827be9e8b54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a805345-374c-4326-9e8f-39bfc7947a35", "name": "network-vif-plugged", "status": "completed", "tag": "d8c64197-b034-4f38-821d-ba030f1fca6b"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:31:53 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-c9e62e4d-846e-4a00-9448-326324e9ff1c req-af48035e-e04f-4e41-884a-0827be9e8b54 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:53 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-c9e62e4d-846e-4a00-9448-326324e9ff1c req-af48035e-e04f-4e41-884a-0827be9e8b54 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:53 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-c9e62e4d-846e-4a00-9448-326324e9ff1c req-af48035e-e04f-4e41-884a-0827be9e8b54 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:53 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-c9e62e4d-846e-4a00-9448-326324e9ff1c req-af48035e-e04f-4e41-884a-0827be9e8b54 service nova] Creating event network-vif-plugged:d8c64197-b034-4f38-821d-ba030f1fca6b for instance 6a805345-374c-4326-9e8f-39bfc7947a35 on user Apr 11 15:31:53 user devstack@n-api.service[61167]: DEBUG nova.compute.api [req-c9e62e4d-846e-4a00-9448-326324e9ff1c req-af48035e-e04f-4e41-884a-0827be9e8b54 service nova] Instance 6a805345-374c-4326-9e8f-39bfc7947a35 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 15:31:53 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-c9e62e4d-846e-4a00-9448-326324e9ff1c req-af48035e-e04f-4e41-884a-0827be9e8b54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051944 Apr 11 15:31:53 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 156/464] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:31:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:31:55 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-203d21e9-3f8d-473a-bb53-6fd0ef2c147e req-6fc115db-e274-40ab-ad29-b1be52b29cb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a805345-374c-4326-9e8f-39bfc7947a35", "name": "network-vif-plugged", "status": "completed", "tag": "d8c64197-b034-4f38-821d-ba030f1fca6b"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:31:55 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-203d21e9-3f8d-473a-bb53-6fd0ef2c147e req-6fc115db-e274-40ab-ad29-b1be52b29cb8 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:31:55 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-203d21e9-3f8d-473a-bb53-6fd0ef2c147e req-6fc115db-e274-40ab-ad29-b1be52b29cb8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:31:55 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-203d21e9-3f8d-473a-bb53-6fd0ef2c147e req-6fc115db-e274-40ab-ad29-b1be52b29cb8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:31:55 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-203d21e9-3f8d-473a-bb53-6fd0ef2c147e req-6fc115db-e274-40ab-ad29-b1be52b29cb8 service nova] Creating event network-vif-plugged:d8c64197-b034-4f38-821d-ba030f1fca6b for instance 6a805345-374c-4326-9e8f-39bfc7947a35 on user Apr 11 15:31:55 user devstack@n-api.service[61166]: DEBUG nova.compute.api [req-203d21e9-3f8d-473a-bb53-6fd0ef2c147e req-6fc115db-e274-40ab-ad29-b1be52b29cb8 service nova] Instance 6a805345-374c-4326-9e8f-39bfc7947a35 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61166) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 15:31:55 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-203d21e9-3f8d-473a-bb53-6fd0ef2c147e req-6fc115db-e274-40ab-ad29-b1be52b29cb8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095565 Apr 11 15:31:55 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 155/465] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:31:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:32:04 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-d28e0fd5-8856-467c-8100-f2489841dc7a tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:32:04 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-d28e0fd5-8856-467c-8100-f2489841dc7a tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:32:04 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=7 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:32:04 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:32:04 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d28e0fd5-8856-467c-8100-f2489841dc7a tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:32:04 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d28e0fd5-8856-467c-8100-f2489841dc7a tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:32:04 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d28e0fd5-8856-467c-8100-f2489841dc7a tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:32:04 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d28e0fd5-8856-467c-8100-f2489841dc7a tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:32:04 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d28e0fd5-8856-467c-8100-f2489841dc7a tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:32:04 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d28e0fd5-8856-467c-8100-f2489841dc7a tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:32:04 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-d28e0fd5-8856-467c-8100-f2489841dc7a tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] HTTP exception thrown: Instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a could not be found. Apr 11 15:32:04 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-d28e0fd5-8856-467c-8100-f2489841dc7a tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Request method failure captured: Apr 11 15:32:04 user devstack@n-api.service[61165]: request: GET /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a HTTP/1.1 Apr 11 15:32:04 user devstack@n-api.service[61165]: Accept: application/json Apr 11 15:32:04 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 15:32:04 user devstack@n-api.service[61165]: Connection: close Apr 11 15:32:04 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 15:32:04 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 15:32:04 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 15:32:04 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 15:32:04 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 15:32:04 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNXyGkiLgEQI-S_7_Wwga7DOpxtyEfFzP1pWYPT5c77zzLkKR7vH_vxHFyKilXHVUsCL6TvTrZV6umuShdOJ_9uxCQ7hBK-f-zsVb2nf_L0LKBTaVlPOyhGSdlDbRw_uAriJQniGXn6BWunbVuJ37qgCjqaIkx-Ld8qhlHwvx0HTva8Q Apr 11 15:32:04 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 15:32:04 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 15:32:04 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 15:32:04 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 15:32:04 user devstack@n-api.service[61165]: X-Openstack-Nova-Api-Version: 2.49 Apr 11 15:32:04 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 15:32:04 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 15:32:04 user devstack@n-api.service[61165]: X-Project-Id: 82dec4b679f24d1e85b1105b4849cddd Apr 11 15:32:04 user devstack@n-api.service[61165]: X-Project-Name: tempest-TaggedAttachmentsTest-727930312 Apr 11 15:32:04 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 15:32:04 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 15:32:04 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/82dec4b679f24d1e85b1105b4849cddd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/82dec4b679f24d1e85b1105b4849cddd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/82dec4b679f24d1e85b1105b4849cddd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:32:04 user devstack@n-api.service[61165]: X-Tenant: tempest-TaggedAttachmentsTest-727930312 Apr 11 15:32:04 user devstack@n-api.service[61165]: X-Tenant-Id: 82dec4b679f24d1e85b1105b4849cddd Apr 11 15:32:04 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-TaggedAttachmentsTest-727930312 Apr 11 15:32:04 user devstack@n-api.service[61165]: X-User: tempest-TaggedAttachmentsTest-727930312-project-member Apr 11 15:32:04 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 15:32:04 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 15:32:04 user devstack@n-api.service[61165]: X-User-Id: f32986358bcc4148ad3f361e3944ed81 Apr 11 15:32:04 user devstack@n-api.service[61165]: X-User-Name: tempest-TaggedAttachmentsTest-727930312-project-member Apr 11 15:32:04 user devstack@n-api.service[61165]: method: > Apr 11 15:32:04 user devstack@n-api.service[61165]: exception: Instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a could not be found. Apr 11 15:32:04 user devstack@n-api.service[61165]: action_args: {'id': '1424f1ff-6c0f-4f9a-bddc-6c448a768a7a'} Apr 11 15:32:04 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a could not be found. Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a could not be found. Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a could not be found. Apr 11 15:32:04 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:32:04 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-d28e0fd5-8856-467c-8100-f2489841dc7a tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Returning 404 to user: Instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:32:04 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-d28e0fd5-8856-467c-8100-f2489841dc7a tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" status: 404 len: 111 microversion: 2.49 time: 0.035841 Apr 11 15:32:04 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 155/466] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:32:04 2023] GET /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 15:32:04 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=3 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:32:04 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=7 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:32:04 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-6ef99a66-e496-463e-8c0a-5bd2c9c33904 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Calling method '.version_select at 0x7f4c2edfb9a0>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:32:04 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-6ef99a66-e496-463e-8c0a-5bd2c9c33904 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1011126544" status: 204 len: 0 microversion: 2.49 time: 0.027086 Apr 11 15:32:04 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 157/467] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Apr 11 15:32:04 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1011126544 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 15:32:05 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-32e9ca84-f5d9-48ac-a3b2-09ab4fd8237e tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:32:05 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-32e9ca84-f5d9-48ac-a3b2-09ab4fd8237e tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:32:05 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=7 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:32:05 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=20,nova_cell1:INSERT=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:32:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-32e9ca84-f5d9-48ac-a3b2-09ab4fd8237e tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:32:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-32e9ca84-f5d9-48ac-a3b2-09ab4fd8237e tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:32:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-32e9ca84-f5d9-48ac-a3b2-09ab4fd8237e tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:32:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-32e9ca84-f5d9-48ac-a3b2-09ab4fd8237e tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:32:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-32e9ca84-f5d9-48ac-a3b2-09ab4fd8237e tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:32:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-32e9ca84-f5d9-48ac-a3b2-09ab4fd8237e tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:32:05 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-32e9ca84-f5d9-48ac-a3b2-09ab4fd8237e tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] HTTP exception thrown: Instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a could not be found. Apr 11 15:32:05 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-32e9ca84-f5d9-48ac-a3b2-09ab4fd8237e tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Request method failure captured: Apr 11 15:32:05 user devstack@n-api.service[61166]: request: DELETE /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a HTTP/1.1 Apr 11 15:32:05 user devstack@n-api.service[61166]: Accept: application/json Apr 11 15:32:05 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 15:32:05 user devstack@n-api.service[61166]: Connection: close Apr 11 15:32:05 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 15:32:05 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 15:32:05 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 15:32:05 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 15:32:05 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 15:32:05 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNXyGkiLgEQI-S_7_Wwga7DOpxtyEfFzP1pWYPT5c77zzLkKR7vH_vxHFyKilXHVUsCL6TvTrZV6umuShdOJ_9uxCQ7hBK-f-zsVb2nf_L0LKBTaVlPOyhGSdlDbRw_uAriJQniGXn6BWunbVuJ37qgCjqaIkx-Ld8qhlHwvx0HTva8Q Apr 11 15:32:05 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 15:32:05 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 15:32:05 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 15:32:05 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 15:32:05 user devstack@n-api.service[61166]: X-Openstack-Nova-Api-Version: 2.49 Apr 11 15:32:05 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 15:32:05 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 15:32:05 user devstack@n-api.service[61166]: X-Project-Id: 82dec4b679f24d1e85b1105b4849cddd Apr 11 15:32:05 user devstack@n-api.service[61166]: X-Project-Name: tempest-TaggedAttachmentsTest-727930312 Apr 11 15:32:05 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 15:32:05 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 15:32:05 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/82dec4b679f24d1e85b1105b4849cddd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/82dec4b679f24d1e85b1105b4849cddd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/82dec4b679f24d1e85b1105b4849cddd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:32:05 user devstack@n-api.service[61166]: X-Tenant: tempest-TaggedAttachmentsTest-727930312 Apr 11 15:32:05 user devstack@n-api.service[61166]: X-Tenant-Id: 82dec4b679f24d1e85b1105b4849cddd Apr 11 15:32:05 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-TaggedAttachmentsTest-727930312 Apr 11 15:32:05 user devstack@n-api.service[61166]: X-User: tempest-TaggedAttachmentsTest-727930312-project-member Apr 11 15:32:05 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 15:32:05 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 15:32:05 user devstack@n-api.service[61166]: X-User-Id: f32986358bcc4148ad3f361e3944ed81 Apr 11 15:32:05 user devstack@n-api.service[61166]: X-User-Name: tempest-TaggedAttachmentsTest-727930312-project-member Apr 11 15:32:05 user devstack@n-api.service[61166]: method: > Apr 11 15:32:05 user devstack@n-api.service[61166]: exception: Instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a could not be found. Apr 11 15:32:05 user devstack@n-api.service[61166]: action_args: {'id': '1424f1ff-6c0f-4f9a-bddc-6c448a768a7a'} Apr 11 15:32:05 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a could not be found. Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a could not be found. Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a could not be found. Apr 11 15:32:05 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:32:05 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-32e9ca84-f5d9-48ac-a3b2-09ab4fd8237e tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Returning 404 to user: Instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a could not be found. {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:32:05 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-32e9ca84-f5d9-48ac-a3b2-09ab4fd8237e tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" status: 404 len: 111 microversion: 2.49 time: 0.039260 Apr 11 15:32:05 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 156/468] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 15:32:05 2023] DELETE /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 15:32:05 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-f10ec26d-e70e-4527-8436-496d8de4a0f4 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:32:05 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-f10ec26d-e70e-4527-8436-496d8de4a0f4 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:32:05 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-f10ec26d-e70e-4527-8436-496d8de4a0f4 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:32:05 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-f10ec26d-e70e-4527-8436-496d8de4a0f4 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:32:05 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-f10ec26d-e70e-4527-8436-496d8de4a0f4 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:32:05 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-f10ec26d-e70e-4527-8436-496d8de4a0f4 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:32:05 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-f10ec26d-e70e-4527-8436-496d8de4a0f4 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:32:05 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-f10ec26d-e70e-4527-8436-496d8de4a0f4 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:32:05 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-f10ec26d-e70e-4527-8436-496d8de4a0f4 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] HTTP exception thrown: Instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a could not be found. Apr 11 15:32:05 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-f10ec26d-e70e-4527-8436-496d8de4a0f4 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Request method failure captured: Apr 11 15:32:05 user devstack@n-api.service[61165]: request: GET /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a HTTP/1.1 Apr 11 15:32:05 user devstack@n-api.service[61165]: Accept: application/json Apr 11 15:32:05 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 15:32:05 user devstack@n-api.service[61165]: Connection: close Apr 11 15:32:05 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 15:32:05 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 15:32:05 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 15:32:05 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 15:32:05 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 15:32:05 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNXyGkiLgEQI-S_7_Wwga7DOpxtyEfFzP1pWYPT5c77zzLkKR7vH_vxHFyKilXHVUsCL6TvTrZV6umuShdOJ_9uxCQ7hBK-f-zsVb2nf_L0LKBTaVlPOyhGSdlDbRw_uAriJQniGXn6BWunbVuJ37qgCjqaIkx-Ld8qhlHwvx0HTva8Q Apr 11 15:32:05 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 15:32:05 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 15:32:05 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 15:32:05 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 15:32:05 user devstack@n-api.service[61165]: X-Openstack-Nova-Api-Version: 2.49 Apr 11 15:32:05 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 15:32:05 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 15:32:05 user devstack@n-api.service[61165]: X-Project-Id: 82dec4b679f24d1e85b1105b4849cddd Apr 11 15:32:05 user devstack@n-api.service[61165]: X-Project-Name: tempest-TaggedAttachmentsTest-727930312 Apr 11 15:32:05 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 15:32:05 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 15:32:05 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/82dec4b679f24d1e85b1105b4849cddd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/82dec4b679f24d1e85b1105b4849cddd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/82dec4b679f24d1e85b1105b4849cddd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:32:05 user devstack@n-api.service[61165]: X-Tenant: tempest-TaggedAttachmentsTest-727930312 Apr 11 15:32:05 user devstack@n-api.service[61165]: X-Tenant-Id: 82dec4b679f24d1e85b1105b4849cddd Apr 11 15:32:05 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-TaggedAttachmentsTest-727930312 Apr 11 15:32:05 user devstack@n-api.service[61165]: X-User: tempest-TaggedAttachmentsTest-727930312-project-member Apr 11 15:32:05 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 15:32:05 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 15:32:05 user devstack@n-api.service[61165]: X-User-Id: f32986358bcc4148ad3f361e3944ed81 Apr 11 15:32:05 user devstack@n-api.service[61165]: X-User-Name: tempest-TaggedAttachmentsTest-727930312-project-member Apr 11 15:32:05 user devstack@n-api.service[61165]: method: > Apr 11 15:32:05 user devstack@n-api.service[61165]: exception: Instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a could not be found. Apr 11 15:32:05 user devstack@n-api.service[61165]: action_args: {'id': '1424f1ff-6c0f-4f9a-bddc-6c448a768a7a'} Apr 11 15:32:05 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a could not be found. Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a could not be found. Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a could not be found. Apr 11 15:32:05 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:32:05 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-f10ec26d-e70e-4527-8436-496d8de4a0f4 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Returning 404 to user: Instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:32:05 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-f10ec26d-e70e-4527-8436-496d8de4a0f4 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" status: 404 len: 111 microversion: 2.49 time: 0.031374 Apr 11 15:32:05 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 156/469] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:32:05 2023] GET /compute/v2.1/servers/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 15:32:15 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:32:15 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-2f837c7c-ac06-4549-ba3d-05f4255499fc tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:32:15 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-2f837c7c-ac06-4549-ba3d-05f4255499fc tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:32:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2f837c7c-ac06-4549-ba3d-05f4255499fc tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:32:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2f837c7c-ac06-4549-ba3d-05f4255499fc tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:32:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2f837c7c-ac06-4549-ba3d-05f4255499fc tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:32:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2f837c7c-ac06-4549-ba3d-05f4255499fc tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:32:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2f837c7c-ac06-4549-ba3d-05f4255499fc tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:32:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2f837c7c-ac06-4549-ba3d-05f4255499fc tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:32:15 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-2f837c7c-ac06-4549-ba3d-05f4255499fc tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:32:15 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-2f837c7c-ac06-4549-ba3d-05f4255499fc tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:32:15 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-2f837c7c-ac06-4549-ba3d-05f4255499fc tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:32:15 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-2f837c7c-ac06-4549-ba3d-05f4255499fc tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59" status: 200 len: 1588 microversion: 2.20 time: 0.152121 Apr 11 15:32:15 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 158/470] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:32:15 2023] GET /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59 => generated 1588 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:32:22 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-3250cfce-f459-46a1-9cde-6db7af25dd14 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:32:22 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-3250cfce-f459-46a1-9cde-6db7af25dd14 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:32:22 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:32:22 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:32:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3250cfce-f459-46a1-9cde-6db7af25dd14 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:32:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3250cfce-f459-46a1-9cde-6db7af25dd14 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:32:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3250cfce-f459-46a1-9cde-6db7af25dd14 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:32:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3250cfce-f459-46a1-9cde-6db7af25dd14 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:32:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3250cfce-f459-46a1-9cde-6db7af25dd14 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:32:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3250cfce-f459-46a1-9cde-6db7af25dd14 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:32:22 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-3250cfce-f459-46a1-9cde-6db7af25dd14 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402ec212c8a64a559f82c166070a92ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f7abe5e3144c7ab354ffaba1748616', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:32:22 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-3250cfce-f459-46a1-9cde-6db7af25dd14 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85658a44-9ff2-4553-b9fd-686bf35fd6ec" status: 200 len: 1537 microversion: 2.1 time: 0.184548 Apr 11 15:32:22 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 157/471] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:32:22 2023] GET /compute/v2.1/servers/85658a44-9ff2-4553-b9fd-686bf35fd6ec => generated 1537 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:32:25 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:32:25 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:32:25 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-315252386", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "52fe638c-5ada-47d5-b376-233bfa808a37", "destination_type": "volume"}], "networks": [{"uuid": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef"}]}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:32:25 user devstack@n-api.service[61165]: DEBUG nova.network.neutron [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] validate_networks() for [('1cf4cec3-ff08-4320-89e4-aa7e8cf75eef', None, None, None, None, None)] {{(pid=61165) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:32:25 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Flavor limits 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:32:25 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Image limits 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:32:25 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Flavor pref 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:32:25 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Image pref 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:32:25 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:32:25 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:32:25 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:32:25 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:32:25 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:32:25 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:32:25 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:32:25 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Getting quotas for project ddc05e9bf5ab426982ccb3092ad596e4. Resources: {'instances', 'cores', 'ram'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:32:25 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Getting quotas for user 1d60ce27bfad4d7c9b976e834df35ad4 and project ddc05e9bf5ab426982ccb3092ad596e4. Resources: {'instances', 'cores', 'ram'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:32:25 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Going to run 1 instances... {{(pid=61165) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:32:25 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52fe638c-5ada-47d5-b376-233bfa808a37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61165) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:32:25 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.748505 Apr 11 15:32:25 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 157/472] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 15:32:25 2023] POST /compute/v2.1/servers => generated 378 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 15:32:25 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-3bf5e2f0-4fdc-420d-982f-0e761a26cb65 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:32:25 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-3bf5e2f0-4fdc-420d-982f-0e761a26cb65 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:32:25 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:32:25 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:32:26 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-3bf5e2f0-4fdc-420d-982f-0e761a26cb65 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:32:26 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-3bf5e2f0-4fdc-420d-982f-0e761a26cb65 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:32:26 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-3bf5e2f0-4fdc-420d-982f-0e761a26cb65 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:32:26 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-3bf5e2f0-4fdc-420d-982f-0e761a26cb65 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d09cda86-eca1-4c42-8654-758eb6cd30e0" status: 200 len: 1394 microversion: 2.87 time: 0.091952 Apr 11 15:32:26 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 159/473] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:32:25 2023] GET /compute/v2.1/servers/d09cda86-eca1-4c42-8654-758eb6cd30e0 => generated 1394 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:32:29 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-617c3f3a-90b1-4e9f-b828-e1304b0c4bc1 req-8c62a1da-cc1f-4b71-8a14-fa9cec244021 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d09cda86-eca1-4c42-8654-758eb6cd30e0", "tag": "27d62f09-c938-4a71-be1e-6dc1d6a47382"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:32:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-617c3f3a-90b1-4e9f-b828-e1304b0c4bc1 req-8c62a1da-cc1f-4b71-8a14-fa9cec244021 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:32:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-617c3f3a-90b1-4e9f-b828-e1304b0c4bc1 req-8c62a1da-cc1f-4b71-8a14-fa9cec244021 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:32:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-617c3f3a-90b1-4e9f-b828-e1304b0c4bc1 req-8c62a1da-cc1f-4b71-8a14-fa9cec244021 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:32:29 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-617c3f3a-90b1-4e9f-b828-e1304b0c4bc1 req-8c62a1da-cc1f-4b71-8a14-fa9cec244021 service nova] Creating event network-changed:27d62f09-c938-4a71-be1e-6dc1d6a47382 for instance d09cda86-eca1-4c42-8654-758eb6cd30e0 on user Apr 11 15:32:29 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-617c3f3a-90b1-4e9f-b828-e1304b0c4bc1 req-8c62a1da-cc1f-4b71-8a14-fa9cec244021 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034647 Apr 11 15:32:29 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 158/474] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:32:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:32:31 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-12047134-f3a3-4503-9808-439d4ce07ca2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:32:31 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-12047134-f3a3-4503-9808-439d4ce07ca2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:32:31 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-12047134-f3a3-4503-9808-439d4ce07ca2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:32:31 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-12047134-f3a3-4503-9808-439d4ce07ca2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:32:31 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-12047134-f3a3-4503-9808-439d4ce07ca2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:32:31 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-12047134-f3a3-4503-9808-439d4ce07ca2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:32:31 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-12047134-f3a3-4503-9808-439d4ce07ca2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:32:31 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-12047134-f3a3-4503-9808-439d4ce07ca2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:32:31 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-12047134-f3a3-4503-9808-439d4ce07ca2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:32:31 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-12047134-f3a3-4503-9808-439d4ce07ca2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35" status: 200 len: 1723 microversion: 2.1 time: 0.170769 Apr 11 15:32:31 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 158/475] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:32:31 2023] GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:32:37 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-cadeca8c-2ba2-4394-b334-50bdc33a6bef tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1568970094", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "52fe638c-5ada-47d5-b376-233bfa808a37", "destination_type": "local"}, {"source_type": "volume", "uuid": "676507e9-0417-4bbf-a4ad-ab2cc1c24a30", "destination_type": "invalid"}], "networks": [{"uuid": "f9b1d398-27cb-42de-9d95-0e031b1bd6ec"}]}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:32:37 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-cadeca8c-2ba2-4394-b334-50bdc33a6bef tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Request method failure captured: Apr 11 15:32:37 user devstack@n-api.service[61167]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 11 15:32:37 user devstack@n-api.service[61167]: Accept: application/json Apr 11 15:32:37 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 15:32:37 user devstack@n-api.service[61167]: Connection: close Apr 11 15:32:37 user devstack@n-api.service[61167]: Content-Length: 494 Apr 11 15:32:37 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 15:32:37 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 15:32:37 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 15:32:37 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 15:32:37 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNXvMrH6hVnA2_xtO12AnSS5L7tEtwltB42V7STqsPFkX1siG8cfx_r3xlA_cAVKU27_eB9mKFYmGM82hgnKgyfM_OCR91O4dZnnWcDasgDkQQ-8ZcPNgPDHtZ3233inf1KKXEOG3V3YOkacFYgC3v5ZLP-n8TcnC_TXgpNqxxNh7uAA Apr 11 15:32:37 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 15:32:37 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 15:32:37 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 15:32:37 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 15:32:37 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 15:32:37 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 15:32:37 user devstack@n-api.service[61167]: X-Project-Id: 561130d089c8415297697bcedc93aefc Apr 11 15:32:37 user devstack@n-api.service[61167]: X-Project-Name: tempest-ServersNegativeTestJSON-1004375615 Apr 11 15:32:37 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 15:32:37 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 15:32:37 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/561130d089c8415297697bcedc93aefc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/561130d089c8415297697bcedc93aefc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/561130d089c8415297697bcedc93aefc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:32:37 user devstack@n-api.service[61167]: X-Tenant: tempest-ServersNegativeTestJSON-1004375615 Apr 11 15:32:37 user devstack@n-api.service[61167]: X-Tenant-Id: 561130d089c8415297697bcedc93aefc Apr 11 15:32:37 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1004375615 Apr 11 15:32:37 user devstack@n-api.service[61167]: X-User: tempest-ServersNegativeTestJSON-1004375615-project-member Apr 11 15:32:37 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 15:32:37 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 15:32:37 user devstack@n-api.service[61167]: X-User-Id: b2538af5c739404aa433b766976e5b2d Apr 11 15:32:37 user devstack@n-api.service[61167]: X-User-Name: tempest-ServersNegativeTestJSON-1004375615-project-member Apr 11 15:32:37 user devstack@n-api.service[61167]: Apr 11 15:32:37 user devstack@n-api.service[61167]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1568970094", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "52fe638c-5ada-47d5-b376-233bfa808a37", "destination_type": "local"}, {"source_type": "volume", "uuid": "676507e9-0417-4bbf-a4ad-ab2cc1c24a30", "destination_type": "invalid"}], "networks": [{"uuid": "f9b1d398-27cb-42de-9d95-0e031b1bd6ec"}]}} Apr 11 15:32:37 user devstack@n-api.service[61167]: method: > Apr 11 15:32:37 user devstack@n-api.service[61167]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 11 15:32:37 user devstack@n-api.service[61167]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1568970094', 'imageRef': '52fe638c-5ada-47d5-b376-233bfa808a37', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '52fe638c-5ada-47d5-b376-233bfa808a37', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '676507e9-0417-4bbf-a4ad-ab2cc1c24a30', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'f9b1d398-27cb-42de-9d95-0e031b1bd6ec'}]}}} Apr 11 15:32:37 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise error Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi 'invalid' Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 11 15:32:37 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:32:37 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-cadeca8c-2ba2-4394-b334-50bdc33a6bef tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:32:37 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-cadeca8c-2ba2-4394-b334-50bdc33a6bef tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.009166 Apr 11 15:32:37 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 160/476] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 15:32:37 2023] POST /compute/v2.1/servers => generated 155 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 15:32:37 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-3961829d-df9e-444b-a432-2aa2b841ad91 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:32:37 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-3961829d-df9e-444b-a432-2aa2b841ad91 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:32:37 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3961829d-df9e-444b-a432-2aa2b841ad91 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:32:37 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3961829d-df9e-444b-a432-2aa2b841ad91 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:32:37 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3961829d-df9e-444b-a432-2aa2b841ad91 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:32:37 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3961829d-df9e-444b-a432-2aa2b841ad91 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:32:37 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3961829d-df9e-444b-a432-2aa2b841ad91 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:32:37 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-3961829d-df9e-444b-a432-2aa2b841ad91 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:32:37 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-3961829d-df9e-444b-a432-2aa2b841ad91 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2538af5c739404aa433b766976e5b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561130d089c8415297697bcedc93aefc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:32:37 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-3961829d-df9e-444b-a432-2aa2b841ad91 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4555892-7abb-4a3c-a4ae-a27ad4902708" status: 200 len: 1493 microversion: 2.1 time: 0.149606 Apr 11 15:32:37 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 159/477] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:32:37 2023] GET /compute/v2.1/servers/e4555892-7abb-4a3c-a4ae-a27ad4902708 => generated 1493 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:32:38 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-dc520100-4901-46b5-bd0e-fb1d81e76ca2 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Action: 'create', calling method: .version_select at 0x7f4c2ec57be0>, body: {"keypair": {"name": "tempest-keypair-1319177828", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrVMNOfvpNw0WxXnYb9GHoGjkGsVckNGNNSEeB0ystk/UW+bmvyI9JyrkIyp1aWJMJE8lx1rxmssoUoMpwQTPTewIcUxPaAcoIQfMD8tyeIllleUvA0Rxy5zvvcCtrC3Q=="}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:32:38 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:32:38 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:32:38 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-dc520100-4901-46b5-bd0e-fb1d81e76ca2 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Getting quotas for project 7df6e56783b84282be0ca425358015dd. Resources: {'key_pairs'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:32:38 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-dc520100-4901-46b5-bd0e-fb1d81e76ca2 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Getting quotas for user 645eeb4fbb2a46d09fd18eaf7de500d0 and project 7df6e56783b84282be0ca425358015dd. Resources: {'key_pairs'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:32:38 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-dc520100-4901-46b5-bd0e-fb1d81e76ca2 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.047002 Apr 11 15:32:38 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 159/478] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 15:32:38 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 15:32:39 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:32:39 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:32:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-ffa7b94d-1cae-4cf4-adf6-f401b3a4c1a4 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:32:39 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-ffa7b94d-1cae-4cf4-adf6-f401b3a4c1a4 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:32:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ffa7b94d-1cae-4cf4-adf6-f401b3a4c1a4 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:32:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ffa7b94d-1cae-4cf4-adf6-f401b3a4c1a4 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:32:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ffa7b94d-1cae-4cf4-adf6-f401b3a4c1a4 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:32:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ffa7b94d-1cae-4cf4-adf6-f401b3a4c1a4 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:32:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ffa7b94d-1cae-4cf4-adf6-f401b3a4c1a4 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:32:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ffa7b94d-1cae-4cf4-adf6-f401b3a4c1a4 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:32:39 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-ffa7b94d-1cae-4cf4-adf6-f401b3a4c1a4 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047065 Apr 11 15:32:39 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 161/479] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:32:39 2023] GET /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 15:32:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1266828186", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "e4b9e2d9-6b8e-4857-bd3e-19c5d7c80f69"}, {"port": "b7d90fa1-965a-4cc7-bc48-64a43041af23", "tag": "port-1"}, {"port": "fafe4f73-4fc5-401b-a2bf-542bea23915f", "tag": "port-2"}, {"uuid": "69f124ac-e977-41ac-8d55-e156f042bab8", "tag": "net-1"}, {"uuid": "69f124ac-e977-41ac-8d55-e156f042bab8"}, {"uuid": "a08657fa-cfdb-4f36-b464-53fe53b857af", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "a08657fa-cfdb-4f36-b464-53fe53b857af", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "08362a1c-0e13-45ed-84c9-e9bcb01bf532", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "19a0b36e-cc56-4f19-904a-03c416d6a452", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "0acddd31-7aa7-4ce3-8628-e562af3c393e", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1736455518"}], "key_name": "tempest-keypair-1319177828", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:32:39 user devstack@n-api.service[61166]: DEBUG nova.network.neutron [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] validate_networks() for [('e4b9e2d9-6b8e-4857-bd3e-19c5d7c80f69', None, None, None, None, None), (None, None, 'b7d90fa1-965a-4cc7-bc48-64a43041af23', None, None, None), (None, None, 'fafe4f73-4fc5-401b-a2bf-542bea23915f', None, None, None), ('69f124ac-e977-41ac-8d55-e156f042bab8', None, None, None, None, None), ('69f124ac-e977-41ac-8d55-e156f042bab8', None, None, None, None, None), ('a08657fa-cfdb-4f36-b464-53fe53b857af', '10.2.2.100', None, None, None, None), ('a08657fa-cfdb-4f36-b464-53fe53b857af', '10.2.2.200', None, None, None, None)] {{(pid=61166) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:32:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-70a93161-efc3-4cdf-9c41-6062251e8b28 req-c8c62aee-f3c4-4e83-8879-6b4194a783b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09cda86-eca1-4c42-8654-758eb6cd30e0", "name": "network-vif-plugged", "status": "completed", "tag": "27d62f09-c938-4a71-be1e-6dc1d6a47382"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:32:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-70a93161-efc3-4cdf-9c41-6062251e8b28 req-c8c62aee-f3c4-4e83-8879-6b4194a783b8 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:32:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-70a93161-efc3-4cdf-9c41-6062251e8b28 req-c8c62aee-f3c4-4e83-8879-6b4194a783b8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:32:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-70a93161-efc3-4cdf-9c41-6062251e8b28 req-c8c62aee-f3c4-4e83-8879-6b4194a783b8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:32:40 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-70a93161-efc3-4cdf-9c41-6062251e8b28 req-c8c62aee-f3c4-4e83-8879-6b4194a783b8 service nova] Creating event network-vif-plugged:27d62f09-c938-4a71-be1e-6dc1d6a47382 for instance d09cda86-eca1-4c42-8654-758eb6cd30e0 on user Apr 11 15:32:40 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-70a93161-efc3-4cdf-9c41-6062251e8b28 req-c8c62aee-f3c4-4e83-8879-6b4194a783b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033906 Apr 11 15:32:40 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 160/480] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:32:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:32:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03f9a930-7552-492c-b996-4c3b05c42706"}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:32:40 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:32:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:32:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:32:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:32:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:32:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:32:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:32:41 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.361468 Apr 11 15:32:41 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 162/481] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 15:32:40 2023] POST /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896/os-volume_attachments => generated 194 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:32:41 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Flavor limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:32:41 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Image limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:32:41 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Flavor pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:32:41 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Image pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:32:41 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:32:41 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:32:41 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:32:41 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:32:41 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:32:41 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:32:41 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:32:41 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Getting quotas for project 7df6e56783b84282be0ca425358015dd. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:32:41 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Getting quotas for user 645eeb4fbb2a46d09fd18eaf7de500d0 and project 7df6e56783b84282be0ca425358015dd. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:32:41 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Going to run 1 instances... {{(pid=61166) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:32:41 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='08362a1c-0e13-45ed-84c9-e9bcb01bf532',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='19a0b36e-cc56-4f19-904a-03c416d6a452',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0acddd31-7aa7-4ce3-8628-e562af3c393e',volume_size=None,volume_type=None)] {{(pid=61166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:32:42 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 2.702240 Apr 11 15:32:42 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 160/482] 10.0.0.210 () {66 vars in 1266 bytes} [Tue Apr 11 15:32:39 2023] POST /compute/v2.1/servers => generated 404 bytes in 2704 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 15:32:42 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-5f82d345-a58e-4793-b09e-8668e6b06c2e tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:32:42 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-5f82d345-a58e-4793-b09e-8668e6b06c2e tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:32:42 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-91501704-a544-499b-8495-b1ca6be3ecc4 req-665b6559-b758-46a7-9a7d-dad2c7d60042 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09cda86-eca1-4c42-8654-758eb6cd30e0", "name": "network-vif-plugged", "status": "completed", "tag": "27d62f09-c938-4a71-be1e-6dc1d6a47382"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:32:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-91501704-a544-499b-8495-b1ca6be3ecc4 req-665b6559-b758-46a7-9a7d-dad2c7d60042 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:32:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-91501704-a544-499b-8495-b1ca6be3ecc4 req-665b6559-b758-46a7-9a7d-dad2c7d60042 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:32:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-91501704-a544-499b-8495-b1ca6be3ecc4 req-665b6559-b758-46a7-9a7d-dad2c7d60042 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:32:42 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-91501704-a544-499b-8495-b1ca6be3ecc4 req-665b6559-b758-46a7-9a7d-dad2c7d60042 service nova] Creating event network-vif-plugged:27d62f09-c938-4a71-be1e-6dc1d6a47382 for instance d09cda86-eca1-4c42-8654-758eb6cd30e0 on user Apr 11 15:32:42 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-91501704-a544-499b-8495-b1ca6be3ecc4 req-665b6559-b758-46a7-9a7d-dad2c7d60042 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028098 Apr 11 15:32:42 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 163/483] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:32:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:32:42 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-5f82d345-a58e-4793-b09e-8668e6b06c2e tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645eeb4fbb2a46d09fd18eaf7de500d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df6e56783b84282be0ca425358015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:32:42 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-5f82d345-a58e-4793-b09e-8668e6b06c2e tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645eeb4fbb2a46d09fd18eaf7de500d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df6e56783b84282be0ca425358015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:32:42 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-5f82d345-a58e-4793-b09e-8668e6b06c2e tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645eeb4fbb2a46d09fd18eaf7de500d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df6e56783b84282be0ca425358015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:32:42 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-5f82d345-a58e-4793-b09e-8668e6b06c2e tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" status: 200 len: 1280 microversion: 2.32 time: 0.100838 Apr 11 15:32:42 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 161/484] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:32:42 2023] GET /compute/v2.1/servers/fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 => generated 1280 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:32:48 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-fbaec3fc-c259-4e26-af7d-818b29068f89 req-af7995d6-767c-4cdb-a757-d2711278c630 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "tag": "7485c140-3c08-4191-9929-3c41cb6fd725"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:32:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-fbaec3fc-c259-4e26-af7d-818b29068f89 req-af7995d6-767c-4cdb-a757-d2711278c630 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:32:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-fbaec3fc-c259-4e26-af7d-818b29068f89 req-af7995d6-767c-4cdb-a757-d2711278c630 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:32:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-fbaec3fc-c259-4e26-af7d-818b29068f89 req-af7995d6-767c-4cdb-a757-d2711278c630 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:32:48 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-fbaec3fc-c259-4e26-af7d-818b29068f89 req-af7995d6-767c-4cdb-a757-d2711278c630 service nova] Creating event network-changed:7485c140-3c08-4191-9929-3c41cb6fd725 for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:32:48 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-fbaec3fc-c259-4e26-af7d-818b29068f89 req-af7995d6-767c-4cdb-a757-d2711278c630 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037597 Apr 11 15:32:48 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 161/485] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:32:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:32:49 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:32:49 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:32:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:32:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:32:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:32:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:32:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:32:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:32:49 user devstack@n-api.service[61167]: DEBUG nova.objects.instance [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lazy-loading 'services' on Instance uuid d534d17d-ba77-4447-8a63-7d6021ad7896 {{(pid=61167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 15:32:49 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896/os-volume_attachments/03f9a930-7552-492c-b996-4c3b05c42706" status: 202 len: 0 microversion: 2.1 time: 0.290817 Apr 11 15:32:49 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 164/486] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 15:32:49 2023] DELETE /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896/os-volume_attachments/03f9a930-7552-492c-b996-4c3b05c42706 => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:32:49 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-73cf2de4-86e5-4d1b-b090-65d93b8823c1 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:32:49 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-73cf2de4-86e5-4d1b-b090-65d93b8823c1 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:32:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-73cf2de4-86e5-4d1b-b090-65d93b8823c1 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:32:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-73cf2de4-86e5-4d1b-b090-65d93b8823c1 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:32:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-73cf2de4-86e5-4d1b-b090-65d93b8823c1 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:32:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-73cf2de4-86e5-4d1b-b090-65d93b8823c1 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:32:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-73cf2de4-86e5-4d1b-b090-65d93b8823c1 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:32:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-73cf2de4-86e5-4d1b-b090-65d93b8823c1 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:32:49 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-73cf2de4-86e5-4d1b-b090-65d93b8823c1 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049967 Apr 11 15:32:49 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 162/487] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:32:49 2023] GET /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:32:50 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-1af23219-295e-4572-9b34-8b1dbf05ffc4 req-074636f9-626b-4964-8849-75f87440a94f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "tag": "b7d90fa1-965a-4cc7-bc48-64a43041af23"}, {"name": "network-changed", "server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "tag": "fafe4f73-4fc5-401b-a2bf-542bea23915f"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:32:50 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-1af23219-295e-4572-9b34-8b1dbf05ffc4 req-074636f9-626b-4964-8849-75f87440a94f service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:32:50 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-1af23219-295e-4572-9b34-8b1dbf05ffc4 req-074636f9-626b-4964-8849-75f87440a94f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:32:50 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-1af23219-295e-4572-9b34-8b1dbf05ffc4 req-074636f9-626b-4964-8849-75f87440a94f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:32:50 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-1af23219-295e-4572-9b34-8b1dbf05ffc4 req-074636f9-626b-4964-8849-75f87440a94f service nova] Creating event network-changed:b7d90fa1-965a-4cc7-bc48-64a43041af23 for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:32:50 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-1af23219-295e-4572-9b34-8b1dbf05ffc4 req-074636f9-626b-4964-8849-75f87440a94f service nova] Creating event network-changed:fafe4f73-4fc5-401b-a2bf-542bea23915f for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:32:50 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-1af23219-295e-4572-9b34-8b1dbf05ffc4 req-074636f9-626b-4964-8849-75f87440a94f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035819 Apr 11 15:32:50 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 162/488] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:32:50 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:32:52 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-1a37ce58-c5af-4e96-9217-bf795276a875 req-0d1139e7-da4c-4d3c-9d53-269c5f5235dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "tag": "44becdbc-fa86-4dbe-ac1a-e0e01648513b"}, {"name": "network-changed", "server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "tag": "bf63f34a-3145-4251-a036-a35bd08ef45f"}, {"name": "network-changed", "server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "tag": "e5066fdb-ea6f-4df5-b185-56f1a0dbe539"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:32:52 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-1a37ce58-c5af-4e96-9217-bf795276a875 req-0d1139e7-da4c-4d3c-9d53-269c5f5235dc service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:32:52 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-1a37ce58-c5af-4e96-9217-bf795276a875 req-0d1139e7-da4c-4d3c-9d53-269c5f5235dc service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:32:52 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-1a37ce58-c5af-4e96-9217-bf795276a875 req-0d1139e7-da4c-4d3c-9d53-269c5f5235dc service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:32:52 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-1a37ce58-c5af-4e96-9217-bf795276a875 req-0d1139e7-da4c-4d3c-9d53-269c5f5235dc service nova] Creating event network-changed:44becdbc-fa86-4dbe-ac1a-e0e01648513b for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:32:52 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-1a37ce58-c5af-4e96-9217-bf795276a875 req-0d1139e7-da4c-4d3c-9d53-269c5f5235dc service nova] Creating event network-changed:bf63f34a-3145-4251-a036-a35bd08ef45f for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:32:52 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-1a37ce58-c5af-4e96-9217-bf795276a875 req-0d1139e7-da4c-4d3c-9d53-269c5f5235dc service nova] Creating event network-changed:e5066fdb-ea6f-4df5-b185-56f1a0dbe539 for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:32:52 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-1a37ce58-c5af-4e96-9217-bf795276a875 req-0d1139e7-da4c-4d3c-9d53-269c5f5235dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.052287 Apr 11 15:32:52 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 165/489] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:32:52 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:32:54 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-5d6fca47-9395-4eb3-8345-fc296994958b req-74c6bfa1-5a52-4405-9440-7c6aac6c2106 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "tag": "b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:32:54 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:32:54 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-5d6fca47-9395-4eb3-8345-fc296994958b req-74c6bfa1-5a52-4405-9440-7c6aac6c2106 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:32:54 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-5d6fca47-9395-4eb3-8345-fc296994958b req-74c6bfa1-5a52-4405-9440-7c6aac6c2106 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:32:54 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-5d6fca47-9395-4eb3-8345-fc296994958b req-74c6bfa1-5a52-4405-9440-7c6aac6c2106 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:32:54 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-5d6fca47-9395-4eb3-8345-fc296994958b req-74c6bfa1-5a52-4405-9440-7c6aac6c2106 service nova] Creating event network-changed:b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:32:54 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-5d6fca47-9395-4eb3-8345-fc296994958b req-74c6bfa1-5a52-4405-9440-7c6aac6c2106 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029406 Apr 11 15:32:54 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 163/490] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:32:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:33:04 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:33:04 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:33:04 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:33:04 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=20 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:33:04 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-705cab4b-a7c3-4b3f-a854-71b755c00847 req-7e5047bf-b5fe-4c82-ab8c-50c2dbf039ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "name": "network-vif-plugged", "status": "completed", "tag": "7485c140-3c08-4191-9929-3c41cb6fd725"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:33:04 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-705cab4b-a7c3-4b3f-a854-71b755c00847 req-7e5047bf-b5fe-4c82-ab8c-50c2dbf039ba service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:04 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-705cab4b-a7c3-4b3f-a854-71b755c00847 req-7e5047bf-b5fe-4c82-ab8c-50c2dbf039ba service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:04 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-705cab4b-a7c3-4b3f-a854-71b755c00847 req-7e5047bf-b5fe-4c82-ab8c-50c2dbf039ba service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:04 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-705cab4b-a7c3-4b3f-a854-71b755c00847 req-7e5047bf-b5fe-4c82-ab8c-50c2dbf039ba service nova] Creating event network-vif-plugged:7485c140-3c08-4191-9929-3c41cb6fd725 for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:33:04 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-705cab4b-a7c3-4b3f-a854-71b755c00847 req-7e5047bf-b5fe-4c82-ab8c-50c2dbf039ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077527 Apr 11 15:33:04 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 163/491] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:33:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:33:04 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=10 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:33:04 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:33:04 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-aef16efc-8db6-4093-b2b7-7580ba3a2a6e req-2cd26fae-575b-4548-9935-3c20fc9b570a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "name": "network-vif-plugged", "status": "completed", "tag": "b7d90fa1-965a-4cc7-bc48-64a43041af23"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:33:04 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-aef16efc-8db6-4093-b2b7-7580ba3a2a6e req-2cd26fae-575b-4548-9935-3c20fc9b570a service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:04 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-aef16efc-8db6-4093-b2b7-7580ba3a2a6e req-2cd26fae-575b-4548-9935-3c20fc9b570a service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:04 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-aef16efc-8db6-4093-b2b7-7580ba3a2a6e req-2cd26fae-575b-4548-9935-3c20fc9b570a service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:04 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-aef16efc-8db6-4093-b2b7-7580ba3a2a6e req-2cd26fae-575b-4548-9935-3c20fc9b570a service nova] Creating event network-vif-plugged:b7d90fa1-965a-4cc7-bc48-64a43041af23 for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:33:04 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-aef16efc-8db6-4093-b2b7-7580ba3a2a6e req-2cd26fae-575b-4548-9935-3c20fc9b570a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056160 Apr 11 15:33:04 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 166/492] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:33:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:33:04 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:33:04 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=18 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:33:04 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-6abd559d-86d6-48d9-be60-f905ccce78f6 req-f2e9fa12-2b5a-429b-b7f3-edcfafce5d80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "name": "network-vif-plugged", "status": "completed", "tag": "fafe4f73-4fc5-401b-a2bf-542bea23915f"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:33:04 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-6abd559d-86d6-48d9-be60-f905ccce78f6 req-f2e9fa12-2b5a-429b-b7f3-edcfafce5d80 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:04 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-6abd559d-86d6-48d9-be60-f905ccce78f6 req-f2e9fa12-2b5a-429b-b7f3-edcfafce5d80 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:04 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-6abd559d-86d6-48d9-be60-f905ccce78f6 req-f2e9fa12-2b5a-429b-b7f3-edcfafce5d80 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:04 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-6abd559d-86d6-48d9-be60-f905ccce78f6 req-f2e9fa12-2b5a-429b-b7f3-edcfafce5d80 service nova] Creating event network-vif-plugged:fafe4f73-4fc5-401b-a2bf-542bea23915f for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:33:04 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-6abd559d-86d6-48d9-be60-f905ccce78f6 req-f2e9fa12-2b5a-429b-b7f3-edcfafce5d80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043577 Apr 11 15:33:04 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 164/493] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:33:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:33:06 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-fb4a171c-6a6a-4a79-ab6a-8b30c99d016b req-1bb4fe93-f196-465a-87d5-4c27d7807bff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "name": "network-vif-plugged", "status": "completed", "tag": "7485c140-3c08-4191-9929-3c41cb6fd725"}, {"server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "name": "network-vif-plugged", "status": "completed", "tag": "bf63f34a-3145-4251-a036-a35bd08ef45f"}, {"server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "name": "network-vif-plugged", "status": "completed", "tag": "bf63f34a-3145-4251-a036-a35bd08ef45f"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:33:06 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-fb4a171c-6a6a-4a79-ab6a-8b30c99d016b req-1bb4fe93-f196-465a-87d5-4c27d7807bff service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:06 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-fb4a171c-6a6a-4a79-ab6a-8b30c99d016b req-1bb4fe93-f196-465a-87d5-4c27d7807bff service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:06 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-fb4a171c-6a6a-4a79-ab6a-8b30c99d016b req-1bb4fe93-f196-465a-87d5-4c27d7807bff service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:06 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-fb4a171c-6a6a-4a79-ab6a-8b30c99d016b req-1bb4fe93-f196-465a-87d5-4c27d7807bff service nova] Creating event network-vif-plugged:7485c140-3c08-4191-9929-3c41cb6fd725 for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:33:06 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-fb4a171c-6a6a-4a79-ab6a-8b30c99d016b req-1bb4fe93-f196-465a-87d5-4c27d7807bff service nova] Creating event network-vif-plugged:bf63f34a-3145-4251-a036-a35bd08ef45f for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:33:06 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-fb4a171c-6a6a-4a79-ab6a-8b30c99d016b req-1bb4fe93-f196-465a-87d5-4c27d7807bff service nova] Creating event network-vif-plugged:bf63f34a-3145-4251-a036-a35bd08ef45f for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:33:06 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-fb4a171c-6a6a-4a79-ab6a-8b30c99d016b req-1bb4fe93-f196-465a-87d5-4c27d7807bff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.038859 Apr 11 15:33:06 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 164/494] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:33:06 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:33:06 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "name": "network-vif-plugged", "status": "completed", "tag": "b7d90fa1-965a-4cc7-bc48-64a43041af23"}, {"server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "name": "network-vif-plugged", "status": "completed", "tag": "44becdbc-fa86-4dbe-ac1a-e0e01648513b"}, {"server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "name": "network-vif-plugged", "status": "completed", "tag": "44becdbc-fa86-4dbe-ac1a-e0e01648513b"}, {"server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "name": "network-vif-plugged", "status": "completed", "tag": "e5066fdb-ea6f-4df5-b185-56f1a0dbe539"}, {"server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "name": "network-vif-plugged", "status": "completed", "tag": "e5066fdb-ea6f-4df5-b185-56f1a0dbe539"}, {"server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "name": "network-vif-plugged", "status": "completed", "tag": "b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:33:06 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:06 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:06 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:06 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] Creating event network-vif-plugged:b7d90fa1-965a-4cc7-bc48-64a43041af23 for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:33:06 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] Creating event network-vif-plugged:44becdbc-fa86-4dbe-ac1a-e0e01648513b for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:33:06 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] Creating event network-vif-plugged:44becdbc-fa86-4dbe-ac1a-e0e01648513b for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:33:06 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] Creating event network-vif-plugged:e5066fdb-ea6f-4df5-b185-56f1a0dbe539 for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:33:06 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] Creating event network-vif-plugged:e5066fdb-ea6f-4df5-b185-56f1a0dbe539 for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:33:06 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] Creating event network-vif-plugged:b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:33:06 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.047286 Apr 11 15:33:06 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 167/495] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:33:06 2023] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:33:06 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-11dc5cf2-8d82-4783-8841-38b346814a81 req-aa9157c8-d7b8-4bf0-a40d-edd90ab61cfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "name": "network-vif-plugged", "status": "completed", "tag": "fafe4f73-4fc5-401b-a2bf-542bea23915f"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:33:06 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-11dc5cf2-8d82-4783-8841-38b346814a81 req-aa9157c8-d7b8-4bf0-a40d-edd90ab61cfe service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:06 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-11dc5cf2-8d82-4783-8841-38b346814a81 req-aa9157c8-d7b8-4bf0-a40d-edd90ab61cfe service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:06 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-11dc5cf2-8d82-4783-8841-38b346814a81 req-aa9157c8-d7b8-4bf0-a40d-edd90ab61cfe service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:06 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-11dc5cf2-8d82-4783-8841-38b346814a81 req-aa9157c8-d7b8-4bf0-a40d-edd90ab61cfe service nova] Creating event network-vif-plugged:fafe4f73-4fc5-401b-a2bf-542bea23915f for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:33:06 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-11dc5cf2-8d82-4783-8841-38b346814a81 req-aa9157c8-d7b8-4bf0-a40d-edd90ab61cfe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028807 Apr 11 15:33:06 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 165/496] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:33:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:33:08 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-950947f2-620a-4b5b-bc24-a1f120a07d11 req-50f18b7c-628c-4ec9-8f8a-e453f155765c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "name": "network-vif-plugged", "status": "completed", "tag": "b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:33:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-950947f2-620a-4b5b-bc24-a1f120a07d11 req-50f18b7c-628c-4ec9-8f8a-e453f155765c service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-950947f2-620a-4b5b-bc24-a1f120a07d11 req-50f18b7c-628c-4ec9-8f8a-e453f155765c service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-950947f2-620a-4b5b-bc24-a1f120a07d11 req-50f18b7c-628c-4ec9-8f8a-e453f155765c service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:08 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-950947f2-620a-4b5b-bc24-a1f120a07d11 req-50f18b7c-628c-4ec9-8f8a-e453f155765c service nova] Creating event network-vif-plugged:b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:33:08 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-950947f2-620a-4b5b-bc24-a1f120a07d11 req-50f18b7c-628c-4ec9-8f8a-e453f155765c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031424 Apr 11 15:33:08 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 165/497] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:33:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:33:15 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-18c0ae50-3951-4d13-9118-cd3055b4b722 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:33:15 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-18c0ae50-3951-4d13-9118-cd3055b4b722 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:33:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-18c0ae50-3951-4d13-9118-cd3055b4b722 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-18c0ae50-3951-4d13-9118-cd3055b4b722 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-18c0ae50-3951-4d13-9118-cd3055b4b722 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-18c0ae50-3951-4d13-9118-cd3055b4b722 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-18c0ae50-3951-4d13-9118-cd3055b4b722 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-18c0ae50-3951-4d13-9118-cd3055b4b722 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:15 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-18c0ae50-3951-4d13-9118-cd3055b4b722 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.098006 Apr 11 15:33:15 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 168/498] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 15:33:15 2023] GET /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/os-interface => generated 283 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 15:33:16 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-22bf1387-d01e-436e-8287-f6f082a1fd47 req-9e887cff-5a37-48ce-b8e6-542f22f0eb80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffc25fc1-e59f-42c8-a371-b4b12e17fd59", "tag": "3ae0cd28-c459-47b7-be17-133b69773f9c"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:33:16 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-22bf1387-d01e-436e-8287-f6f082a1fd47 req-9e887cff-5a37-48ce-b8e6-542f22f0eb80 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:16 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-22bf1387-d01e-436e-8287-f6f082a1fd47 req-9e887cff-5a37-48ce-b8e6-542f22f0eb80 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:16 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-22bf1387-d01e-436e-8287-f6f082a1fd47 req-9e887cff-5a37-48ce-b8e6-542f22f0eb80 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:16 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-b8f8782a-4e9f-42ae-a419-09d45a5e9d03 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:33:16 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-b8f8782a-4e9f-42ae-a419-09d45a5e9d03 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:33:16 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-22bf1387-d01e-436e-8287-f6f082a1fd47 req-9e887cff-5a37-48ce-b8e6-542f22f0eb80 service nova] Creating event network-changed:3ae0cd28-c459-47b7-be17-133b69773f9c for instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 on user Apr 11 15:33:16 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-22bf1387-d01e-436e-8287-f6f082a1fd47 req-9e887cff-5a37-48ce-b8e6-542f22f0eb80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035303 Apr 11 15:33:16 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 166/499] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:33:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:33:16 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b8f8782a-4e9f-42ae-a419-09d45a5e9d03 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:16 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b8f8782a-4e9f-42ae-a419-09d45a5e9d03 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:16 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b8f8782a-4e9f-42ae-a419-09d45a5e9d03 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:16 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b8f8782a-4e9f-42ae-a419-09d45a5e9d03 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:16 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b8f8782a-4e9f-42ae-a419-09d45a5e9d03 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:16 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b8f8782a-4e9f-42ae-a419-09d45a5e9d03 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:16 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-9464a5f3-ba9c-4f2d-8337-c234290716b7 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:33:16 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-9464a5f3-ba9c-4f2d-8337-c234290716b7 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:33:16 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-9464a5f3-ba9c-4f2d-8337-c234290716b7 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:16 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-9464a5f3-ba9c-4f2d-8337-c234290716b7 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:16 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-9464a5f3-ba9c-4f2d-8337-c234290716b7 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:16 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-9464a5f3-ba9c-4f2d-8337-c234290716b7 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:16 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-9464a5f3-ba9c-4f2d-8337-c234290716b7 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:16 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-9464a5f3-ba9c-4f2d-8337-c234290716b7 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:16 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-9464a5f3-ba9c-4f2d-8337-c234290716b7 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/ips" status: 200 len: 110 microversion: 2.20 time: 0.035221 Apr 11 15:33:16 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 169/500] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Apr 11 15:33:16 2023] GET /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/ips => generated 110 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 15:33:16 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-b8f8782a-4e9f-42ae-a419-09d45a5e9d03 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:33:16 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-b8f8782a-4e9f-42ae-a419-09d45a5e9d03 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:33:16 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-b8f8782a-4e9f-42ae-a419-09d45a5e9d03 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:33:16 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-b8f8782a-4e9f-42ae-a419-09d45a5e9d03 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d09cda86-eca1-4c42-8654-758eb6cd30e0" status: 200 len: 1767 microversion: 2.87 time: 0.219524 Apr 11 15:33:16 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 166/501] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:33:16 2023] GET /compute/v2.1/servers/d09cda86-eca1-4c42-8654-758eb6cd30e0 => generated 1767 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:33:17 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:33:17 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:33:17 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:17 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:17 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:17 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:17 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:17 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:17 user devstack@n-api.service[61165]: DEBUG nova.objects.instance [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lazy-loading 'flavor' on Instance uuid ffc25fc1-e59f-42c8-a371-b4b12e17fd59 {{(pid=61165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 15:33:18 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/action" status: 202 len: 0 microversion: 2.20 time: 0.999688 Apr 11 15:33:18 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 167/502] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 15:33:17 2023] POST /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/action => generated 0 bytes in 1002 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:33:18 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-4a553711-7fe5-44a7-84a4-75f802cee01f tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:33:18 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-4a553711-7fe5-44a7-84a4-75f802cee01f tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:33:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4a553711-7fe5-44a7-84a4-75f802cee01f tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4a553711-7fe5-44a7-84a4-75f802cee01f tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4a553711-7fe5-44a7-84a4-75f802cee01f tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4a553711-7fe5-44a7-84a4-75f802cee01f tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4a553711-7fe5-44a7-84a4-75f802cee01f tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4a553711-7fe5-44a7-84a4-75f802cee01f tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:18 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-4a553711-7fe5-44a7-84a4-75f802cee01f tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:33:18 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-4a553711-7fe5-44a7-84a4-75f802cee01f tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:33:18 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-4a553711-7fe5-44a7-84a4-75f802cee01f tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:33:18 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-4a553711-7fe5-44a7-84a4-75f802cee01f tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59" status: 200 len: 1713 microversion: 2.20 time: 0.173957 Apr 11 15:33:18 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 170/503] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:33:18 2023] GET /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59 => generated 1713 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:33:19 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-b66b60b5-7e71-4b58-87d0-3982039db371 req-7c543db8-68e5-4193-a662-2d6cb6a22883 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc25fc1-e59f-42c8-a371-b4b12e17fd59", "name": "network-vif-unplugged", "status": "completed", "tag": "3ae0cd28-c459-47b7-be17-133b69773f9c"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:33:19 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-b66b60b5-7e71-4b58-87d0-3982039db371 req-7c543db8-68e5-4193-a662-2d6cb6a22883 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:19 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-b66b60b5-7e71-4b58-87d0-3982039db371 req-7c543db8-68e5-4193-a662-2d6cb6a22883 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:19 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-b66b60b5-7e71-4b58-87d0-3982039db371 req-7c543db8-68e5-4193-a662-2d6cb6a22883 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:19 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-b66b60b5-7e71-4b58-87d0-3982039db371 req-7c543db8-68e5-4193-a662-2d6cb6a22883 service nova] Creating event network-vif-unplugged:3ae0cd28-c459-47b7-be17-133b69773f9c for instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 on user Apr 11 15:33:19 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-b66b60b5-7e71-4b58-87d0-3982039db371 req-7c543db8-68e5-4193-a662-2d6cb6a22883 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044921 Apr 11 15:33:19 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 167/504] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:33:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:33:21 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-fb1c30a0-5ac7-4dae-a5f6-a56ab1cd56f6 req-00b55ac6-632e-4fd0-809e-a7962d5f3529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc25fc1-e59f-42c8-a371-b4b12e17fd59", "name": "network-vif-plugged", "status": "completed", "tag": "3ae0cd28-c459-47b7-be17-133b69773f9c"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:33:21 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-fb1c30a0-5ac7-4dae-a5f6-a56ab1cd56f6 req-00b55ac6-632e-4fd0-809e-a7962d5f3529 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:21 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-fb1c30a0-5ac7-4dae-a5f6-a56ab1cd56f6 req-00b55ac6-632e-4fd0-809e-a7962d5f3529 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:21 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-fb1c30a0-5ac7-4dae-a5f6-a56ab1cd56f6 req-00b55ac6-632e-4fd0-809e-a7962d5f3529 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:21 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-fb1c30a0-5ac7-4dae-a5f6-a56ab1cd56f6 req-00b55ac6-632e-4fd0-809e-a7962d5f3529 service nova] Creating event network-vif-plugged:3ae0cd28-c459-47b7-be17-133b69773f9c for instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 on user Apr 11 15:33:21 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-fb1c30a0-5ac7-4dae-a5f6-a56ab1cd56f6 req-00b55ac6-632e-4fd0-809e-a7962d5f3529 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032024 Apr 11 15:33:21 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 168/505] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:33:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:33:22 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-0aa5e17f-11b0-4653-a58d-aafda9dfa212 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:33:22 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-0aa5e17f-11b0-4653-a58d-aafda9dfa212 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:33:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-0aa5e17f-11b0-4653-a58d-aafda9dfa212 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-0aa5e17f-11b0-4653-a58d-aafda9dfa212 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-0aa5e17f-11b0-4653-a58d-aafda9dfa212 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-0aa5e17f-11b0-4653-a58d-aafda9dfa212 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-0aa5e17f-11b0-4653-a58d-aafda9dfa212 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-0aa5e17f-11b0-4653-a58d-aafda9dfa212 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:22 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-0aa5e17f-11b0-4653-a58d-aafda9dfa212 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402ec212c8a64a559f82c166070a92ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f7abe5e3144c7ab354ffaba1748616', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:33:22 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-0aa5e17f-11b0-4653-a58d-aafda9dfa212 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85658a44-9ff2-4553-b9fd-686bf35fd6ec" status: 200 len: 1537 microversion: 2.1 time: 0.211390 Apr 11 15:33:22 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 171/506] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:33:22 2023] GET /compute/v2.1/servers/85658a44-9ff2-4553-b9fd-686bf35fd6ec => generated 1537 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:33:23 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-e989d00c-a2dc-4ba0-9ce6-da06b604a976 req-5cd71a7f-121c-4de7-b74a-a7a4b869e25c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffc25fc1-e59f-42c8-a371-b4b12e17fd59", "tag": "3ae0cd28-c459-47b7-be17-133b69773f9c"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:33:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-e989d00c-a2dc-4ba0-9ce6-da06b604a976 req-5cd71a7f-121c-4de7-b74a-a7a4b869e25c service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-e989d00c-a2dc-4ba0-9ce6-da06b604a976 req-5cd71a7f-121c-4de7-b74a-a7a4b869e25c service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-e989d00c-a2dc-4ba0-9ce6-da06b604a976 req-5cd71a7f-121c-4de7-b74a-a7a4b869e25c service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:23 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-e989d00c-a2dc-4ba0-9ce6-da06b604a976 req-5cd71a7f-121c-4de7-b74a-a7a4b869e25c service nova] Creating event network-changed:3ae0cd28-c459-47b7-be17-133b69773f9c for instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 on user Apr 11 15:33:23 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-e989d00c-a2dc-4ba0-9ce6-da06b604a976 req-5cd71a7f-121c-4de7-b74a-a7a4b869e25c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057683 Apr 11 15:33:23 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 168/507] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:33:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:33:24 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-a7b7e238-891a-4656-84d7-d456122b8936 req-caa5c11a-1497-49d8-b4d7-98e9cda967f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85658a44-9ff2-4553-b9fd-686bf35fd6ec", "tag": "c6826c01-eadd-49db-a842-accd25f7534a"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:33:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-a7b7e238-891a-4656-84d7-d456122b8936 req-caa5c11a-1497-49d8-b4d7-98e9cda967f6 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-a7b7e238-891a-4656-84d7-d456122b8936 req-caa5c11a-1497-49d8-b4d7-98e9cda967f6 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-a7b7e238-891a-4656-84d7-d456122b8936 req-caa5c11a-1497-49d8-b4d7-98e9cda967f6 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:24 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-a7b7e238-891a-4656-84d7-d456122b8936 req-caa5c11a-1497-49d8-b4d7-98e9cda967f6 service nova] Creating event network-changed:c6826c01-eadd-49db-a842-accd25f7534a for instance 85658a44-9ff2-4553-b9fd-686bf35fd6ec on user Apr 11 15:33:24 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-a7b7e238-891a-4656-84d7-d456122b8936 req-caa5c11a-1497-49d8-b4d7-98e9cda967f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033179 Apr 11 15:33:24 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 169/508] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:33:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 15:33:24 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5975605f-731a-43b1-8fef-2c0b05624d1a"}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:33:24 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:33:24 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:24 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:24 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:24 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:24 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:24 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:24 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] 10.0.0.210 "POST /compute/v2.1/servers/85658a44-9ff2-4553-b9fd-686bf35fd6ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280480 Apr 11 15:33:24 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 172/509] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 15:33:24 2023] POST /compute/v2.1/servers/85658a44-9ff2-4553-b9fd-686bf35fd6ec/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:33:31 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-e8d012a2-4659-4b7c-aac7-a3d93c348da9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:33:31 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-e8d012a2-4659-4b7c-aac7-a3d93c348da9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:33:31 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e8d012a2-4659-4b7c-aac7-a3d93c348da9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:31 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e8d012a2-4659-4b7c-aac7-a3d93c348da9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:31 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e8d012a2-4659-4b7c-aac7-a3d93c348da9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:31 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e8d012a2-4659-4b7c-aac7-a3d93c348da9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:31 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e8d012a2-4659-4b7c-aac7-a3d93c348da9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:31 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e8d012a2-4659-4b7c-aac7-a3d93c348da9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:32 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-e8d012a2-4659-4b7c-aac7-a3d93c348da9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:33:32 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-e8d012a2-4659-4b7c-aac7-a3d93c348da9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35" status: 200 len: 1723 microversion: 2.1 time: 0.260088 Apr 11 15:33:32 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 169/510] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:33:31 2023] GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35 => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:33:32 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-2e9a0440-c495-45b6-9ac9-dfa295acb2f9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:33:32 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-2e9a0440-c495-45b6-9ac9-dfa295acb2f9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:33:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-2e9a0440-c495-45b6-9ac9-dfa295acb2f9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-2e9a0440-c495-45b6-9ac9-dfa295acb2f9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-2e9a0440-c495-45b6-9ac9-dfa295acb2f9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-2e9a0440-c495-45b6-9ac9-dfa295acb2f9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-2e9a0440-c495-45b6-9ac9-dfa295acb2f9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-2e9a0440-c495-45b6-9ac9-dfa295acb2f9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:32 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-2e9a0440-c495-45b6-9ac9-dfa295acb2f9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:33:32 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-2e9a0440-c495-45b6-9ac9-dfa295acb2f9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35" status: 200 len: 1723 microversion: 2.1 time: 0.153026 Apr 11 15:33:32 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 170/511] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:33:32 2023] GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:33:32 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-fbd97241-f4a8-42d2-a9c8-91fa705f558f tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:33:32 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-fbd97241-f4a8-42d2-a9c8-91fa705f558f tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:33:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-fbd97241-f4a8-42d2-a9c8-91fa705f558f tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-fbd97241-f4a8-42d2-a9c8-91fa705f558f tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-fbd97241-f4a8-42d2-a9c8-91fa705f558f tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-fbd97241-f4a8-42d2-a9c8-91fa705f558f tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-fbd97241-f4a8-42d2-a9c8-91fa705f558f tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-fbd97241-f4a8-42d2-a9c8-91fa705f558f tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:32 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:33:32 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:33:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:32 user devstack@n-api.service[61166]: DEBUG nova.objects.instance [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lazy-loading 'services' on Instance uuid 85658a44-9ff2-4553-b9fd-686bf35fd6ec {{(pid=61166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 15:33:32 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-fbd97241-f4a8-42d2-a9c8-91fa705f558f tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645eeb4fbb2a46d09fd18eaf7de500d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df6e56783b84282be0ca425358015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:33:32 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-fbd97241-f4a8-42d2-a9c8-91fa705f558f tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645eeb4fbb2a46d09fd18eaf7de500d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df6e56783b84282be0ca425358015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:33:32 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-fbd97241-f4a8-42d2-a9c8-91fa705f558f tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645eeb4fbb2a46d09fd18eaf7de500d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df6e56783b84282be0ca425358015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:33:32 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-fbd97241-f4a8-42d2-a9c8-91fa705f558f tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" status: 200 len: 2823 microversion: 2.32 time: 0.194204 Apr 11 15:33:32 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 173/512] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:33:32 2023] GET /compute/v2.1/servers/fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 => generated 2823 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:33:32 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/85658a44-9ff2-4553-b9fd-686bf35fd6ec/os-volume_attachments/5975605f-731a-43b1-8fef-2c0b05624d1a" status: 202 len: 0 microversion: 2.1 time: 0.201067 Apr 11 15:33:32 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 170/513] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 15:33:32 2023] DELETE /compute/v2.1/servers/85658a44-9ff2-4553-b9fd-686bf35fd6ec/os-volume_attachments/5975605f-731a-43b1-8fef-2c0b05624d1a => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:33:32 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-7d9fa82a-3417-42fe-a164-f42703442543 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:33:32 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-7d9fa82a-3417-42fe-a164-f42703442543 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:33:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7d9fa82a-3417-42fe-a164-f42703442543 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7d9fa82a-3417-42fe-a164-f42703442543 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7d9fa82a-3417-42fe-a164-f42703442543 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7d9fa82a-3417-42fe-a164-f42703442543 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7d9fa82a-3417-42fe-a164-f42703442543 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7d9fa82a-3417-42fe-a164-f42703442543 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:32 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-7d9fa82a-3417-42fe-a164-f42703442543 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85658a44-9ff2-4553-b9fd-686bf35fd6ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043581 Apr 11 15:33:32 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 171/514] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:33:32 2023] GET /compute/v2.1/servers/85658a44-9ff2-4553-b9fd-686bf35fd6ec/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:33:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-44f8b76e-2d7c-4b4e-8c77-3bf1c17aebc2 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:33:39 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-44f8b76e-2d7c-4b4e-8c77-3bf1c17aebc2 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:33:39 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=17 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:33:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-44f8b76e-2d7c-4b4e-8c77-3bf1c17aebc2 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-44f8b76e-2d7c-4b4e-8c77-3bf1c17aebc2 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-44f8b76e-2d7c-4b4e-8c77-3bf1c17aebc2 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-44f8b76e-2d7c-4b4e-8c77-3bf1c17aebc2 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-44f8b76e-2d7c-4b4e-8c77-3bf1c17aebc2 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-44f8b76e-2d7c-4b4e-8c77-3bf1c17aebc2 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:39 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:33:39 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-44f8b76e-2d7c-4b4e-8c77-3bf1c17aebc2 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051922 Apr 11 15:33:39 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 174/515] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:33:39 2023] GET /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 15:33:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-ac2ed488-c0d4-49db-8c96-d6153a7be182 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:33:40 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-ac2ed488-c0d4-49db-8c96-d6153a7be182 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:33:40 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=19 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:33:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ac2ed488-c0d4-49db-8c96-d6153a7be182 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ac2ed488-c0d4-49db-8c96-d6153a7be182 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ac2ed488-c0d4-49db-8c96-d6153a7be182 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ac2ed488-c0d4-49db-8c96-d6153a7be182 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ac2ed488-c0d4-49db-8c96-d6153a7be182 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ac2ed488-c0d4-49db-8c96-d6153a7be182 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:40 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=32,nova_cell1:INSERT=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:33:40 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-ac2ed488-c0d4-49db-8c96-d6153a7be182 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] HTTP exception thrown: Instance f846ecc9-ecc4-4e8f-aca3-39d83b56f414 could not be found. Apr 11 15:33:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-ac2ed488-c0d4-49db-8c96-d6153a7be182 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Request method failure captured: Apr 11 15:33:40 user devstack@n-api.service[61166]: request: DELETE /compute/v2.1/servers/f846ecc9-ecc4-4e8f-aca3-39d83b56f414 HTTP/1.1 Apr 11 15:33:40 user devstack@n-api.service[61166]: Accept: application/json Apr 11 15:33:40 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 15:33:40 user devstack@n-api.service[61166]: Connection: close Apr 11 15:33:40 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 15:33:40 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 15:33:40 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 15:33:40 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 15:33:40 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 15:33:40 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNXvMrH6hVnA2_xtO12AnSS5L7tEtwltB42V7STqsPFkX1siG8cfx_r3xlA_cAVKU27_eB9mKFYmGM82hgnKgyfM_OCR91O4dZnnWcDasgDkQQ-8ZcPNgPDHtZ3233inf1KKXEOG3V3YOkacFYgC3v5ZLP-n8TcnC_TXgpNqxxNh7uAA Apr 11 15:33:40 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 15:33:40 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 15:33:40 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 15:33:40 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 15:33:40 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 15:33:40 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 15:33:40 user devstack@n-api.service[61166]: X-Project-Id: 561130d089c8415297697bcedc93aefc Apr 11 15:33:40 user devstack@n-api.service[61166]: X-Project-Name: tempest-ServersNegativeTestJSON-1004375615 Apr 11 15:33:40 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 15:33:40 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 15:33:40 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/561130d089c8415297697bcedc93aefc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/561130d089c8415297697bcedc93aefc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/561130d089c8415297697bcedc93aefc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:33:40 user devstack@n-api.service[61166]: X-Tenant: tempest-ServersNegativeTestJSON-1004375615 Apr 11 15:33:40 user devstack@n-api.service[61166]: X-Tenant-Id: 561130d089c8415297697bcedc93aefc Apr 11 15:33:40 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1004375615 Apr 11 15:33:40 user devstack@n-api.service[61166]: X-User: tempest-ServersNegativeTestJSON-1004375615-project-member Apr 11 15:33:40 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 15:33:40 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 15:33:40 user devstack@n-api.service[61166]: X-User-Id: b2538af5c739404aa433b766976e5b2d Apr 11 15:33:40 user devstack@n-api.service[61166]: X-User-Name: tempest-ServersNegativeTestJSON-1004375615-project-member Apr 11 15:33:40 user devstack@n-api.service[61166]: method: > Apr 11 15:33:40 user devstack@n-api.service[61166]: exception: Instance f846ecc9-ecc4-4e8f-aca3-39d83b56f414 could not be found. Apr 11 15:33:40 user devstack@n-api.service[61166]: action_args: {'id': 'f846ecc9-ecc4-4e8f-aca3-39d83b56f414'} Apr 11 15:33:40 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f846ecc9-ecc4-4e8f-aca3-39d83b56f414 could not be found. Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f846ecc9-ecc4-4e8f-aca3-39d83b56f414 could not be found. Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f846ecc9-ecc4-4e8f-aca3-39d83b56f414 could not be found. Apr 11 15:33:40 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:33:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-ac2ed488-c0d4-49db-8c96-d6153a7be182 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Returning 404 to user: Instance f846ecc9-ecc4-4e8f-aca3-39d83b56f414 could not be found. {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:33:40 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-ac2ed488-c0d4-49db-8c96-d6153a7be182 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f846ecc9-ecc4-4e8f-aca3-39d83b56f414" status: 404 len: 111 microversion: 2.1 time: 0.038006 Apr 11 15:33:40 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 171/516] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:33:40 2023] DELETE /compute/v2.1/servers/f846ecc9-ecc4-4e8f-aca3-39d83b56f414 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:33:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-da6aeaf8-c4ce-48f2-b560-0daeec9e0f61 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:33:40 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-da6aeaf8-c4ce-48f2-b560-0daeec9e0f61 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:33:40 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=17 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:33:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-da6aeaf8-c4ce-48f2-b560-0daeec9e0f61 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-da6aeaf8-c4ce-48f2-b560-0daeec9e0f61 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-da6aeaf8-c4ce-48f2-b560-0daeec9e0f61 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-da6aeaf8-c4ce-48f2-b560-0daeec9e0f61 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-da6aeaf8-c4ce-48f2-b560-0daeec9e0f61 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-da6aeaf8-c4ce-48f2-b560-0daeec9e0f61 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:40 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:33:40 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-da6aeaf8-c4ce-48f2-b560-0daeec9e0f61 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] HTTP exception thrown: Instance f846ecc9-ecc4-4e8f-aca3-39d83b56f414 could not be found. Apr 11 15:33:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-da6aeaf8-c4ce-48f2-b560-0daeec9e0f61 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Request method failure captured: Apr 11 15:33:40 user devstack@n-api.service[61165]: request: GET /compute/v2.1/servers/f846ecc9-ecc4-4e8f-aca3-39d83b56f414 HTTP/1.1 Apr 11 15:33:40 user devstack@n-api.service[61165]: Accept: application/json Apr 11 15:33:40 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 15:33:40 user devstack@n-api.service[61165]: Connection: close Apr 11 15:33:40 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 15:33:40 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 15:33:40 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 15:33:40 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 15:33:40 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 15:33:40 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNXvMrH6hVnA2_xtO12AnSS5L7tEtwltB42V7STqsPFkX1siG8cfx_r3xlA_cAVKU27_eB9mKFYmGM82hgnKgyfM_OCR91O4dZnnWcDasgDkQQ-8ZcPNgPDHtZ3233inf1KKXEOG3V3YOkacFYgC3v5ZLP-n8TcnC_TXgpNqxxNh7uAA Apr 11 15:33:40 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 15:33:40 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 15:33:40 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 15:33:40 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 15:33:40 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 15:33:40 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 15:33:40 user devstack@n-api.service[61165]: X-Project-Id: 561130d089c8415297697bcedc93aefc Apr 11 15:33:40 user devstack@n-api.service[61165]: X-Project-Name: tempest-ServersNegativeTestJSON-1004375615 Apr 11 15:33:40 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 15:33:40 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 15:33:40 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/561130d089c8415297697bcedc93aefc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/561130d089c8415297697bcedc93aefc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/561130d089c8415297697bcedc93aefc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:33:40 user devstack@n-api.service[61165]: X-Tenant: tempest-ServersNegativeTestJSON-1004375615 Apr 11 15:33:40 user devstack@n-api.service[61165]: X-Tenant-Id: 561130d089c8415297697bcedc93aefc Apr 11 15:33:40 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1004375615 Apr 11 15:33:40 user devstack@n-api.service[61165]: X-User: tempest-ServersNegativeTestJSON-1004375615-project-member Apr 11 15:33:40 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 15:33:40 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 15:33:40 user devstack@n-api.service[61165]: X-User-Id: b2538af5c739404aa433b766976e5b2d Apr 11 15:33:40 user devstack@n-api.service[61165]: X-User-Name: tempest-ServersNegativeTestJSON-1004375615-project-member Apr 11 15:33:40 user devstack@n-api.service[61165]: method: > Apr 11 15:33:40 user devstack@n-api.service[61165]: exception: Instance f846ecc9-ecc4-4e8f-aca3-39d83b56f414 could not be found. Apr 11 15:33:40 user devstack@n-api.service[61165]: action_args: {'id': 'f846ecc9-ecc4-4e8f-aca3-39d83b56f414'} Apr 11 15:33:40 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f846ecc9-ecc4-4e8f-aca3-39d83b56f414 could not be found. Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f846ecc9-ecc4-4e8f-aca3-39d83b56f414 could not be found. Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f846ecc9-ecc4-4e8f-aca3-39d83b56f414 could not be found. Apr 11 15:33:40 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:33:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-da6aeaf8-c4ce-48f2-b560-0daeec9e0f61 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Returning 404 to user: Instance f846ecc9-ecc4-4e8f-aca3-39d83b56f414 could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:33:40 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-da6aeaf8-c4ce-48f2-b560-0daeec9e0f61 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f846ecc9-ecc4-4e8f-aca3-39d83b56f414" status: 404 len: 111 microversion: 2.1 time: 0.037143 Apr 11 15:33:40 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 172/517] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:33:40 2023] GET /compute/v2.1/servers/f846ecc9-ecc4-4e8f-aca3-39d83b56f414 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:33:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:33:40 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:33:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:40 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Going to try to terminate instance {{(pid=61167) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:33:40 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e4555892-7abb-4a3c-a4ae-a27ad4902708" status: 204 len: 0 microversion: 2.1 time: 0.129039 Apr 11 15:33:40 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 175/518] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:33:40 2023] DELETE /compute/v2.1/servers/e4555892-7abb-4a3c-a4ae-a27ad4902708 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:33:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-831d1786-82a0-499a-a569-86211377c0e6 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:33:40 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-831d1786-82a0-499a-a569-86211377c0e6 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:33:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-831d1786-82a0-499a-a569-86211377c0e6 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-831d1786-82a0-499a-a569-86211377c0e6 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-831d1786-82a0-499a-a569-86211377c0e6 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-831d1786-82a0-499a-a569-86211377c0e6 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-831d1786-82a0-499a-a569-86211377c0e6 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-831d1786-82a0-499a-a569-86211377c0e6 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:40 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-831d1786-82a0-499a-a569-86211377c0e6 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2538af5c739404aa433b766976e5b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561130d089c8415297697bcedc93aefc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:33:40 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-831d1786-82a0-499a-a569-86211377c0e6 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4555892-7abb-4a3c-a4ae-a27ad4902708" status: 200 len: 1499 microversion: 2.1 time: 0.189306 Apr 11 15:33:40 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 172/519] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:33:40 2023] GET /compute/v2.1/servers/e4555892-7abb-4a3c-a4ae-a27ad4902708 => generated 1499 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:33:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-c05dbe1a-0864-4030-9f40-1b9d87e4b05c req-f84807f8-4eb6-4cba-9baf-1799aea9829b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4555892-7abb-4a3c-a4ae-a27ad4902708", "name": "network-vif-unplugged", "status": "completed", "tag": "a002e821-ea54-4d5c-b25c-8c517fab4e92"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:33:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-c05dbe1a-0864-4030-9f40-1b9d87e4b05c req-f84807f8-4eb6-4cba-9baf-1799aea9829b service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-c05dbe1a-0864-4030-9f40-1b9d87e4b05c req-f84807f8-4eb6-4cba-9baf-1799aea9829b service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-c05dbe1a-0864-4030-9f40-1b9d87e4b05c req-f84807f8-4eb6-4cba-9baf-1799aea9829b service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:40 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-c05dbe1a-0864-4030-9f40-1b9d87e4b05c req-f84807f8-4eb6-4cba-9baf-1799aea9829b service nova] Creating event network-vif-unplugged:a002e821-ea54-4d5c-b25c-8c517fab4e92 for instance e4555892-7abb-4a3c-a4ae-a27ad4902708 on user Apr 11 15:33:40 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-c05dbe1a-0864-4030-9f40-1b9d87e4b05c req-f84807f8-4eb6-4cba-9baf-1799aea9829b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030723 Apr 11 15:33:40 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 173/520] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:33:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:33:41 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-143f5844-dac1-4f4d-b6ed-e657972757a4 req-17d5c960-b8a3-4dbc-b02b-69d5a3477aca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4555892-7abb-4a3c-a4ae-a27ad4902708", "name": "network-vif-deleted", "tag": "a002e821-ea54-4d5c-b25c-8c517fab4e92"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:33:41 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-143f5844-dac1-4f4d-b6ed-e657972757a4 req-17d5c960-b8a3-4dbc-b02b-69d5a3477aca service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:41 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-143f5844-dac1-4f4d-b6ed-e657972757a4 req-17d5c960-b8a3-4dbc-b02b-69d5a3477aca service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:41 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-143f5844-dac1-4f4d-b6ed-e657972757a4 req-17d5c960-b8a3-4dbc-b02b-69d5a3477aca service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:41 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-143f5844-dac1-4f4d-b6ed-e657972757a4 req-17d5c960-b8a3-4dbc-b02b-69d5a3477aca service nova] Creating event network-vif-deleted:a002e821-ea54-4d5c-b25c-8c517fab4e92 for instance e4555892-7abb-4a3c-a4ae-a27ad4902708 on user Apr 11 15:33:41 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-143f5844-dac1-4f4d-b6ed-e657972757a4 req-17d5c960-b8a3-4dbc-b02b-69d5a3477aca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034639 Apr 11 15:33:41 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 176/521] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:33:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:33:42 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-a7415769-9f44-442f-ad26-71b21a691d3d req-c4553d3f-6ec7-4352-8c18-1b1471a44bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4555892-7abb-4a3c-a4ae-a27ad4902708", "name": "network-vif-plugged", "status": "completed", "tag": "a002e821-ea54-4d5c-b25c-8c517fab4e92"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:33:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-a7415769-9f44-442f-ad26-71b21a691d3d req-c4553d3f-6ec7-4352-8c18-1b1471a44bd9 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-a7415769-9f44-442f-ad26-71b21a691d3d req-c4553d3f-6ec7-4352-8c18-1b1471a44bd9 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-a7415769-9f44-442f-ad26-71b21a691d3d req-c4553d3f-6ec7-4352-8c18-1b1471a44bd9 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:42 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-a7415769-9f44-442f-ad26-71b21a691d3d req-c4553d3f-6ec7-4352-8c18-1b1471a44bd9 service nova] Creating event network-vif-plugged:a002e821-ea54-4d5c-b25c-8c517fab4e92 for instance e4555892-7abb-4a3c-a4ae-a27ad4902708 on user Apr 11 15:33:42 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-a7415769-9f44-442f-ad26-71b21a691d3d req-c4553d3f-6ec7-4352-8c18-1b1471a44bd9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037588 Apr 11 15:33:42 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 173/522] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:33:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:33:47 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-f906bb88-25b2-4b10-8f14-feee6f1a8a98 req-e2470765-bf85-4410-abab-68e806d2bc4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d534d17d-ba77-4447-8a63-7d6021ad7896", "tag": "05f23fee-4450-48d6-8b2f-6c1fcf308da6"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:33:47 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-f906bb88-25b2-4b10-8f14-feee6f1a8a98 req-e2470765-bf85-4410-abab-68e806d2bc4c service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:47 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-f906bb88-25b2-4b10-8f14-feee6f1a8a98 req-e2470765-bf85-4410-abab-68e806d2bc4c service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:47 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-f906bb88-25b2-4b10-8f14-feee6f1a8a98 req-e2470765-bf85-4410-abab-68e806d2bc4c service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:47 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-f906bb88-25b2-4b10-8f14-feee6f1a8a98 req-e2470765-bf85-4410-abab-68e806d2bc4c service nova] Creating event network-changed:05f23fee-4450-48d6-8b2f-6c1fcf308da6 for instance d534d17d-ba77-4447-8a63-7d6021ad7896 on user Apr 11 15:33:47 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-f906bb88-25b2-4b10-8f14-feee6f1a8a98 req-e2470765-bf85-4410-abab-68e806d2bc4c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029602 Apr 11 15:33:47 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 174/523] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:33:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:33:48 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:33:48 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:33:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:48 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Going to try to terminate instance {{(pid=61167) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:33:49 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896" status: 204 len: 0 microversion: 2.1 time: 0.148152 Apr 11 15:33:49 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 177/524] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:33:48 2023] DELETE /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:33:49 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-a7e341ff-81f4-420a-8461-d283a94cc7b3 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:33:49 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-a7e341ff-81f4-420a-8461-d283a94cc7b3 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:33:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-a7e341ff-81f4-420a-8461-d283a94cc7b3 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-a7e341ff-81f4-420a-8461-d283a94cc7b3 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-a7e341ff-81f4-420a-8461-d283a94cc7b3 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-a7e341ff-81f4-420a-8461-d283a94cc7b3 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-a7e341ff-81f4-420a-8461-d283a94cc7b3 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-a7e341ff-81f4-420a-8461-d283a94cc7b3 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:49 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-a7e341ff-81f4-420a-8461-d283a94cc7b3 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ece3baa634583a7cc3000c78f2c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bfd48094c54cd5b13dabf27ebdd5dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:33:49 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-a7e341ff-81f4-420a-8461-d283a94cc7b3 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896" status: 200 len: 1573 microversion: 2.1 time: 0.221926 Apr 11 15:33:49 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 174/525] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:33:49 2023] GET /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896 => generated 1573 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:33:49 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-c9b6b266-61db-4ee7-9d79-4958234b87de req-e357739f-12e3-4a77-a12c-e9d2d63f8ff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d534d17d-ba77-4447-8a63-7d6021ad7896", "name": "network-vif-unplugged", "status": "completed", "tag": "05f23fee-4450-48d6-8b2f-6c1fcf308da6"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:33:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-c9b6b266-61db-4ee7-9d79-4958234b87de req-e357739f-12e3-4a77-a12c-e9d2d63f8ff6 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-c9b6b266-61db-4ee7-9d79-4958234b87de req-e357739f-12e3-4a77-a12c-e9d2d63f8ff6 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-c9b6b266-61db-4ee7-9d79-4958234b87de req-e357739f-12e3-4a77-a12c-e9d2d63f8ff6 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:49 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-c9b6b266-61db-4ee7-9d79-4958234b87de req-e357739f-12e3-4a77-a12c-e9d2d63f8ff6 service nova] Creating event network-vif-unplugged:05f23fee-4450-48d6-8b2f-6c1fcf308da6 for instance d534d17d-ba77-4447-8a63-7d6021ad7896 on user Apr 11 15:33:49 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-c9b6b266-61db-4ee7-9d79-4958234b87de req-e357739f-12e3-4a77-a12c-e9d2d63f8ff6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033249 Apr 11 15:33:49 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 175/526] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:33:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:33:51 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-683a9f17-6699-4604-ba95-926871bf5d78 req-081dc9f0-3e58-4f87-97ae-cff19fd93a07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d534d17d-ba77-4447-8a63-7d6021ad7896", "name": "network-vif-plugged", "status": "completed", "tag": "05f23fee-4450-48d6-8b2f-6c1fcf308da6"}, {"server_uuid": "d534d17d-ba77-4447-8a63-7d6021ad7896", "name": "network-vif-deleted", "tag": "05f23fee-4450-48d6-8b2f-6c1fcf308da6"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:33:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-683a9f17-6699-4604-ba95-926871bf5d78 req-081dc9f0-3e58-4f87-97ae-cff19fd93a07 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:33:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-683a9f17-6699-4604-ba95-926871bf5d78 req-081dc9f0-3e58-4f87-97ae-cff19fd93a07 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:33:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-683a9f17-6699-4604-ba95-926871bf5d78 req-081dc9f0-3e58-4f87-97ae-cff19fd93a07 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:33:51 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-683a9f17-6699-4604-ba95-926871bf5d78 req-081dc9f0-3e58-4f87-97ae-cff19fd93a07 service nova] Creating event network-vif-plugged:05f23fee-4450-48d6-8b2f-6c1fcf308da6 for instance d534d17d-ba77-4447-8a63-7d6021ad7896 on user Apr 11 15:33:51 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-683a9f17-6699-4604-ba95-926871bf5d78 req-081dc9f0-3e58-4f87-97ae-cff19fd93a07 service nova] Creating event network-vif-deleted:05f23fee-4450-48d6-8b2f-6c1fcf308da6 for instance d534d17d-ba77-4447-8a63-7d6021ad7896 on user Apr 11 15:33:51 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-683a9f17-6699-4604-ba95-926871bf5d78 req-081dc9f0-3e58-4f87-97ae-cff19fd93a07 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030198 Apr 11 15:33:51 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 178/527] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:33:51 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:34:08 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-21ae7b21-cafc-45dd-a4a4-e7c8be7bc02e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:34:08 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-21ae7b21-cafc-45dd-a4a4-e7c8be7bc02e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:34:08 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=7 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:34:08 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=15 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:34:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-21ae7b21-cafc-45dd-a4a4-e7c8be7bc02e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-21ae7b21-cafc-45dd-a4a4-e7c8be7bc02e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-21ae7b21-cafc-45dd-a4a4-e7c8be7bc02e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-21ae7b21-cafc-45dd-a4a4-e7c8be7bc02e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-21ae7b21-cafc-45dd-a4a4-e7c8be7bc02e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-21ae7b21-cafc-45dd-a4a4-e7c8be7bc02e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:09 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-21ae7b21-cafc-45dd-a4a4-e7c8be7bc02e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:34:09 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-21ae7b21-cafc-45dd-a4a4-e7c8be7bc02e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:34:09 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-21ae7b21-cafc-45dd-a4a4-e7c8be7bc02e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:34:09 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-21ae7b21-cafc-45dd-a4a4-e7c8be7bc02e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59" status: 200 len: 1654 microversion: 2.20 time: 0.160104 Apr 11 15:34:09 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 175/528] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:34:08 2023] GET /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59 => generated 1654 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:34:16 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "efa37656-35d8-4725-8f33-96c342005b9e"}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:34:16 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:34:16 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=7 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:34:16 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=7 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:34:16 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:16 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:16 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:16 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:16 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:16 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:16 user devstack@n-api.service[61165]: DEBUG nova.objects.instance [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lazy-loading 'flavor' on Instance uuid d09cda86-eca1-4c42-8654-758eb6cd30e0 {{(pid=61165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 15:34:17 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d09cda86-eca1-4c42-8654-758eb6cd30e0/action" status: 200 len: 29 microversion: 2.87 time: 0.583900 Apr 11 15:34:17 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 176/529] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 15:34:16 2023] POST /compute/v2.1/servers/d09cda86-eca1-4c42-8654-758eb6cd30e0/action => generated 29 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:34:17 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:34:17 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:34:17 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-7fa72518-7d2a-4c9e-93f4-a20df0d2427b tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:34:17 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-7fa72518-7d2a-4c9e-93f4-a20df0d2427b tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:34:17 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7fa72518-7d2a-4c9e-93f4-a20df0d2427b tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:17 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7fa72518-7d2a-4c9e-93f4-a20df0d2427b tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:17 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7fa72518-7d2a-4c9e-93f4-a20df0d2427b tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:17 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7fa72518-7d2a-4c9e-93f4-a20df0d2427b tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:17 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7fa72518-7d2a-4c9e-93f4-a20df0d2427b tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:17 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7fa72518-7d2a-4c9e-93f4-a20df0d2427b tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:17 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-7fa72518-7d2a-4c9e-93f4-a20df0d2427b tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:34:17 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-7fa72518-7d2a-4c9e-93f4-a20df0d2427b tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:34:17 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-7fa72518-7d2a-4c9e-93f4-a20df0d2427b tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:34:17 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-7fa72518-7d2a-4c9e-93f4-a20df0d2427b tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d09cda86-eca1-4c42-8654-758eb6cd30e0" status: 200 len: 1773 microversion: 2.87 time: 0.172213 Apr 11 15:34:17 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 179/530] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:34:17 2023] GET /compute/v2.1/servers/d09cda86-eca1-4c42-8654-758eb6cd30e0 => generated 1773 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:34:18 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-86a87fdb-675d-4d30-8aa5-0e3a62cdcb2b req-e2d25adb-d495-4cde-a120-451c3addc660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09cda86-eca1-4c42-8654-758eb6cd30e0", "name": "network-vif-unplugged", "status": "completed", "tag": "27d62f09-c938-4a71-be1e-6dc1d6a47382"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:34:18 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-86a87fdb-675d-4d30-8aa5-0e3a62cdcb2b req-e2d25adb-d495-4cde-a120-451c3addc660 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:18 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-86a87fdb-675d-4d30-8aa5-0e3a62cdcb2b req-e2d25adb-d495-4cde-a120-451c3addc660 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:18 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-86a87fdb-675d-4d30-8aa5-0e3a62cdcb2b req-e2d25adb-d495-4cde-a120-451c3addc660 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:18 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-86a87fdb-675d-4d30-8aa5-0e3a62cdcb2b req-e2d25adb-d495-4cde-a120-451c3addc660 service nova] Creating event network-vif-unplugged:27d62f09-c938-4a71-be1e-6dc1d6a47382 for instance d09cda86-eca1-4c42-8654-758eb6cd30e0 on user Apr 11 15:34:18 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-86a87fdb-675d-4d30-8aa5-0e3a62cdcb2b req-e2d25adb-d495-4cde-a120-451c3addc660 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030299 Apr 11 15:34:18 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 176/531] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:34:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:34:20 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-f69d19e1-df64-486e-8dc3-d348d746b5ab req-40509b61-cef5-4577-bfea-4999fff40c9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09cda86-eca1-4c42-8654-758eb6cd30e0", "name": "network-vif-plugged", "status": "completed", "tag": "27d62f09-c938-4a71-be1e-6dc1d6a47382"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:34:20 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-f69d19e1-df64-486e-8dc3-d348d746b5ab req-40509b61-cef5-4577-bfea-4999fff40c9d service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:20 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-f69d19e1-df64-486e-8dc3-d348d746b5ab req-40509b61-cef5-4577-bfea-4999fff40c9d service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:20 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-f69d19e1-df64-486e-8dc3-d348d746b5ab req-40509b61-cef5-4577-bfea-4999fff40c9d service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:20 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-f69d19e1-df64-486e-8dc3-d348d746b5ab req-40509b61-cef5-4577-bfea-4999fff40c9d service nova] Creating event network-vif-plugged:27d62f09-c938-4a71-be1e-6dc1d6a47382 for instance d09cda86-eca1-4c42-8654-758eb6cd30e0 on user Apr 11 15:34:20 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-f69d19e1-df64-486e-8dc3-d348d746b5ab req-40509b61-cef5-4577-bfea-4999fff40c9d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031886 Apr 11 15:34:20 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 177/532] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:34:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:34:22 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-22d9a45b-92f0-48ce-b0d9-c20f0996eae1 req-d32f5303-a003-4634-8ce7-10fb00f996a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09cda86-eca1-4c42-8654-758eb6cd30e0", "name": "network-vif-plugged", "status": "completed", "tag": "27d62f09-c938-4a71-be1e-6dc1d6a47382"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:34:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-22d9a45b-92f0-48ce-b0d9-c20f0996eae1 req-d32f5303-a003-4634-8ce7-10fb00f996a0 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-22d9a45b-92f0-48ce-b0d9-c20f0996eae1 req-d32f5303-a003-4634-8ce7-10fb00f996a0 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-22d9a45b-92f0-48ce-b0d9-c20f0996eae1 req-d32f5303-a003-4634-8ce7-10fb00f996a0 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:22 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-22d9a45b-92f0-48ce-b0d9-c20f0996eae1 req-d32f5303-a003-4634-8ce7-10fb00f996a0 service nova] Creating event network-vif-plugged:27d62f09-c938-4a71-be1e-6dc1d6a47382 for instance d09cda86-eca1-4c42-8654-758eb6cd30e0 on user Apr 11 15:34:22 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-22d9a45b-92f0-48ce-b0d9-c20f0996eae1 req-d32f5303-a003-4634-8ce7-10fb00f996a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045069 Apr 11 15:34:22 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 180/533] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:34:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:34:22 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-0e1bf244-65b1-4683-9c55-4408eb2c8fe0 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:34:22 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-0e1bf244-65b1-4683-9c55-4408eb2c8fe0 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:34:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0e1bf244-65b1-4683-9c55-4408eb2c8fe0 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0e1bf244-65b1-4683-9c55-4408eb2c8fe0 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0e1bf244-65b1-4683-9c55-4408eb2c8fe0 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0e1bf244-65b1-4683-9c55-4408eb2c8fe0 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0e1bf244-65b1-4683-9c55-4408eb2c8fe0 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0e1bf244-65b1-4683-9c55-4408eb2c8fe0 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:22 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-0e1bf244-65b1-4683-9c55-4408eb2c8fe0 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85658a44-9ff2-4553-b9fd-686bf35fd6ec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046029 Apr 11 15:34:22 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 177/534] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:34:22 2023] GET /compute/v2.1/servers/85658a44-9ff2-4553-b9fd-686bf35fd6ec/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 15:34:24 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-45e261d9-ac8a-4dfd-88f8-a8799c3caa80 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-123167437"}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:34:24 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-45e261d9-ac8a-4dfd-88f8-a8799c3caa80 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:34:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-45e261d9-ac8a-4dfd-88f8-a8799c3caa80 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-45e261d9-ac8a-4dfd-88f8-a8799c3caa80 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-45e261d9-ac8a-4dfd-88f8-a8799c3caa80 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-45e261d9-ac8a-4dfd-88f8-a8799c3caa80 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-45e261d9-ac8a-4dfd-88f8-a8799c3caa80 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-45e261d9-ac8a-4dfd-88f8-a8799c3caa80 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:24 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-ac512ba4-dedd-4596-98e6-632e1f4f2d16 req-84ae1c53-b8bc-4e05-be57-9f4cdacfe20d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09cda86-eca1-4c42-8654-758eb6cd30e0", "name": "network-vif-plugged", "status": "completed", "tag": "27d62f09-c938-4a71-be1e-6dc1d6a47382"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:34:24 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-ac512ba4-dedd-4596-98e6-632e1f4f2d16 req-84ae1c53-b8bc-4e05-be57-9f4cdacfe20d service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:24 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-ac512ba4-dedd-4596-98e6-632e1f4f2d16 req-84ae1c53-b8bc-4e05-be57-9f4cdacfe20d service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:24 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-ac512ba4-dedd-4596-98e6-632e1f4f2d16 req-84ae1c53-b8bc-4e05-be57-9f4cdacfe20d service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:24 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-ac512ba4-dedd-4596-98e6-632e1f4f2d16 req-84ae1c53-b8bc-4e05-be57-9f4cdacfe20d service nova] Creating event network-vif-plugged:27d62f09-c938-4a71-be1e-6dc1d6a47382 for instance d09cda86-eca1-4c42-8654-758eb6cd30e0 on user Apr 11 15:34:24 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-ac512ba4-dedd-4596-98e6-632e1f4f2d16 req-84ae1c53-b8bc-4e05-be57-9f4cdacfe20d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028779 Apr 11 15:34:24 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 181/535] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:34:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:34:25 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-45e261d9-ac8a-4dfd-88f8-a8799c3caa80 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] 10.0.0.210 "POST /compute/v2.1/servers/85658a44-9ff2-4553-b9fd-686bf35fd6ec/action" status: 202 len: 0 microversion: 2.1 time: 0.873397 Apr 11 15:34:25 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 178/536] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 15:34:24 2023] POST /compute/v2.1/servers/85658a44-9ff2-4553-b9fd-686bf35fd6ec/action => generated 0 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 11 15:34:30 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-77ffe5a2-7899-4d4c-87d6-ef39bc7d6902 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:34:30 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-77ffe5a2-7899-4d4c-87d6-ef39bc7d6902 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:34:30 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-77ffe5a2-7899-4d4c-87d6-ef39bc7d6902 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:30 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-77ffe5a2-7899-4d4c-87d6-ef39bc7d6902 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:30 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-77ffe5a2-7899-4d4c-87d6-ef39bc7d6902 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:30 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-77ffe5a2-7899-4d4c-87d6-ef39bc7d6902 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:30 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-77ffe5a2-7899-4d4c-87d6-ef39bc7d6902 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:30 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-77ffe5a2-7899-4d4c-87d6-ef39bc7d6902 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:30 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-77ffe5a2-7899-4d4c-87d6-ef39bc7d6902 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] HTTP exception thrown: Instance e4555892-7abb-4a3c-a4ae-a27ad4902708 could not be found. Apr 11 15:34:30 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-77ffe5a2-7899-4d4c-87d6-ef39bc7d6902 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Request method failure captured: Apr 11 15:34:30 user devstack@n-api.service[61166]: request: GET /compute/v2.1/servers/e4555892-7abb-4a3c-a4ae-a27ad4902708 HTTP/1.1 Apr 11 15:34:30 user devstack@n-api.service[61166]: Accept: application/json Apr 11 15:34:30 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 15:34:30 user devstack@n-api.service[61166]: Connection: close Apr 11 15:34:30 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 15:34:30 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 15:34:30 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 15:34:30 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 15:34:30 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 15:34:30 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNXvMrH6hVnA2_xtO12AnSS5L7tEtwltB42V7STqsPFkX1siG8cfx_r3xlA_cAVKU27_eB9mKFYmGM82hgnKgyfM_OCR91O4dZnnWcDasgDkQQ-8ZcPNgPDHtZ3233inf1KKXEOG3V3YOkacFYgC3v5ZLP-n8TcnC_TXgpNqxxNh7uAA Apr 11 15:34:30 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 15:34:30 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 15:34:30 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 15:34:30 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 15:34:30 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 15:34:30 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 15:34:30 user devstack@n-api.service[61166]: X-Project-Id: 561130d089c8415297697bcedc93aefc Apr 11 15:34:30 user devstack@n-api.service[61166]: X-Project-Name: tempest-ServersNegativeTestJSON-1004375615 Apr 11 15:34:30 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 15:34:30 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 15:34:30 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/561130d089c8415297697bcedc93aefc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/561130d089c8415297697bcedc93aefc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/561130d089c8415297697bcedc93aefc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:34:30 user devstack@n-api.service[61166]: X-Tenant: tempest-ServersNegativeTestJSON-1004375615 Apr 11 15:34:30 user devstack@n-api.service[61166]: X-Tenant-Id: 561130d089c8415297697bcedc93aefc Apr 11 15:34:30 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1004375615 Apr 11 15:34:30 user devstack@n-api.service[61166]: X-User: tempest-ServersNegativeTestJSON-1004375615-project-member Apr 11 15:34:30 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 15:34:30 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 15:34:30 user devstack@n-api.service[61166]: X-User-Id: b2538af5c739404aa433b766976e5b2d Apr 11 15:34:30 user devstack@n-api.service[61166]: X-User-Name: tempest-ServersNegativeTestJSON-1004375615-project-member Apr 11 15:34:30 user devstack@n-api.service[61166]: method: > Apr 11 15:34:30 user devstack@n-api.service[61166]: exception: Instance e4555892-7abb-4a3c-a4ae-a27ad4902708 could not be found. Apr 11 15:34:30 user devstack@n-api.service[61166]: action_args: {'id': 'e4555892-7abb-4a3c-a4ae-a27ad4902708'} Apr 11 15:34:30 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4555892-7abb-4a3c-a4ae-a27ad4902708 could not be found. Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4555892-7abb-4a3c-a4ae-a27ad4902708 could not be found. Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4555892-7abb-4a3c-a4ae-a27ad4902708 could not be found. Apr 11 15:34:30 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:34:30 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-77ffe5a2-7899-4d4c-87d6-ef39bc7d6902 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Returning 404 to user: Instance e4555892-7abb-4a3c-a4ae-a27ad4902708 could not be found. {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:34:30 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-77ffe5a2-7899-4d4c-87d6-ef39bc7d6902 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4555892-7abb-4a3c-a4ae-a27ad4902708" status: 404 len: 111 microversion: 2.1 time: 0.029701 Apr 11 15:34:30 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 178/537] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:34:30 2023] GET /compute/v2.1/servers/e4555892-7abb-4a3c-a4ae-a27ad4902708 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:34:31 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1403839106", "imageRef": "acf06024-4378-482a-bbf6-6ff8213c4958", "flavorRef": "42", "key_name": "tempest-TestStampPattern-416277054", "security_groups": [{"name": "tempest-secgroup-smoke-411530607"}], "networks": [{"uuid": "8dd93667-4f8b-4d89-b7be-056f5f39bffe"}]}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:34:31 user devstack@n-api.service[61167]: DEBUG nova.network.neutron [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] validate_networks() for [('8dd93667-4f8b-4d89-b7be-056f5f39bffe', None, None, None, None, None)] {{(pid=61167) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:34:32 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Flavor limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:34:32 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Image limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:34:32 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Flavor pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:34:32 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Image pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:34:32 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:34:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:32 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:34:32 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:34:32 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Getting quotas for project f0f7abe5e3144c7ab354ffaba1748616. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:34:32 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Getting quotas for user 402ec212c8a64a559f82c166070a92ef and project f0f7abe5e3144c7ab354ffaba1748616. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:34:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:32 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Going to run 1 instances... {{(pid=61167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:34:32 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acf06024-4378-482a-bbf6-6ff8213c4958',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:34:32 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Going to try to terminate instance {{(pid=61165) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:34:32 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.692737 Apr 11 15:34:32 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 182/538] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 15:34:31 2023] POST /compute/v2.1/servers => generated 403 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 15:34:32 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-ca3c9b7f-08f8-43cb-83c6-bf80156bd17b tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:34:32 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-ca3c9b7f-08f8-43cb-83c6-bf80156bd17b tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:34:32 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35" status: 204 len: 0 microversion: 2.1 time: 0.142346 Apr 11 15:34:32 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 179/539] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:34:32 2023] DELETE /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:34:32 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-c6a1d635-474f-4396-956b-ff21c953a89e tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:34:32 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-c6a1d635-474f-4396-956b-ff21c953a89e tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:34:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c6a1d635-474f-4396-956b-ff21c953a89e tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c6a1d635-474f-4396-956b-ff21c953a89e tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c6a1d635-474f-4396-956b-ff21c953a89e tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c6a1d635-474f-4396-956b-ff21c953a89e tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c6a1d635-474f-4396-956b-ff21c953a89e tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c6a1d635-474f-4396-956b-ff21c953a89e tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:32 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-ca3c9b7f-08f8-43cb-83c6-bf80156bd17b tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402ec212c8a64a559f82c166070a92ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f7abe5e3144c7ab354ffaba1748616', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:34:32 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-ca3c9b7f-08f8-43cb-83c6-bf80156bd17b tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f34c2249-840e-4475-87e6-648d173bc7ed" status: 200 len: 1236 microversion: 2.1 time: 0.094697 Apr 11 15:34:32 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 179/540] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:34:32 2023] GET /compute/v2.1/servers/f34c2249-840e-4475-87e6-648d173bc7ed => generated 1236 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:34:32 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-c6a1d635-474f-4396-956b-ff21c953a89e tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:34:32 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-9bf0f725-ba80-4039-a44c-80d6c5ea74d2 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:34:32 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-9bf0f725-ba80-4039-a44c-80d6c5ea74d2 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:34:32 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-c6a1d635-474f-4396-956b-ff21c953a89e tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35" status: 200 len: 1729 microversion: 2.1 time: 0.226421 Apr 11 15:34:32 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 183/541] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:34:32 2023] GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35 => generated 1729 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:34:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-9bf0f725-ba80-4039-a44c-80d6c5ea74d2 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-9bf0f725-ba80-4039-a44c-80d6c5ea74d2 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-9bf0f725-ba80-4039-a44c-80d6c5ea74d2 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-9bf0f725-ba80-4039-a44c-80d6c5ea74d2 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-9bf0f725-ba80-4039-a44c-80d6c5ea74d2 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-9bf0f725-ba80-4039-a44c-80d6c5ea74d2 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:32 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-9bf0f725-ba80-4039-a44c-80d6c5ea74d2 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fa6dc9c1-6786-4c17-a23e-f71c21ac08a7/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.175037 Apr 11 15:34:32 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 180/542] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 15:34:32 2023] GET /compute/v2.1/servers/fa6dc9c1-6786-4c17-a23e-f71c21ac08a7/os-interface => generated 1830 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:34:33 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-361c12b1-0c7e-4e41-868b-27a88adb6709 req-ebd668b2-78e6-405a-af63-1f18151042a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a805345-374c-4326-9e8f-39bfc7947a35", "name": "network-vif-unplugged", "status": "completed", "tag": "d8c64197-b034-4f38-821d-ba030f1fca6b"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:34:33 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-361c12b1-0c7e-4e41-868b-27a88adb6709 req-ebd668b2-78e6-405a-af63-1f18151042a7 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:33 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-361c12b1-0c7e-4e41-868b-27a88adb6709 req-ebd668b2-78e6-405a-af63-1f18151042a7 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:33 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-361c12b1-0c7e-4e41-868b-27a88adb6709 req-ebd668b2-78e6-405a-af63-1f18151042a7 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:33 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-361c12b1-0c7e-4e41-868b-27a88adb6709 req-ebd668b2-78e6-405a-af63-1f18151042a7 service nova] Creating event network-vif-unplugged:d8c64197-b034-4f38-821d-ba030f1fca6b for instance 6a805345-374c-4326-9e8f-39bfc7947a35 on user Apr 11 15:34:33 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-361c12b1-0c7e-4e41-868b-27a88adb6709 req-ebd668b2-78e6-405a-af63-1f18151042a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042705 Apr 11 15:34:33 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 180/543] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:34:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:34:34 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-5bd1fd99-df41-4d11-89a4-8f3b9ab8f0af req-fac8790c-b89b-4114-aba2-a9f131632c96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "tag": "7485c140-3c08-4191-9929-3c41cb6fd725"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:34:34 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-5bd1fd99-df41-4d11-89a4-8f3b9ab8f0af req-fac8790c-b89b-4114-aba2-a9f131632c96 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:34 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-5bd1fd99-df41-4d11-89a4-8f3b9ab8f0af req-fac8790c-b89b-4114-aba2-a9f131632c96 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:34 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-5bd1fd99-df41-4d11-89a4-8f3b9ab8f0af req-fac8790c-b89b-4114-aba2-a9f131632c96 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:34 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-5bd1fd99-df41-4d11-89a4-8f3b9ab8f0af req-fac8790c-b89b-4114-aba2-a9f131632c96 service nova] Creating event network-changed:7485c140-3c08-4191-9929-3c41cb6fd725 for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:34:34 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-749b1c6f-3298-4d2a-a467-472ce2fbded4 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:34:34 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-749b1c6f-3298-4d2a-a467-472ce2fbded4 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:34:34 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-5bd1fd99-df41-4d11-89a4-8f3b9ab8f0af req-fac8790c-b89b-4114-aba2-a9f131632c96 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040905 Apr 11 15:34:34 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 184/544] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:34:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 15:34:34 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-749b1c6f-3298-4d2a-a467-472ce2fbded4 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:34 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-749b1c6f-3298-4d2a-a467-472ce2fbded4 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:34 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-749b1c6f-3298-4d2a-a467-472ce2fbded4 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:34 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-749b1c6f-3298-4d2a-a467-472ce2fbded4 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:34 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-749b1c6f-3298-4d2a-a467-472ce2fbded4 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:34 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-749b1c6f-3298-4d2a-a467-472ce2fbded4 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:35 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-749b1c6f-3298-4d2a-a467-472ce2fbded4 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645eeb4fbb2a46d09fd18eaf7de500d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df6e56783b84282be0ca425358015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:34:35 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-749b1c6f-3298-4d2a-a467-472ce2fbded4 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645eeb4fbb2a46d09fd18eaf7de500d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df6e56783b84282be0ca425358015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:34:35 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-749b1c6f-3298-4d2a-a467-472ce2fbded4 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645eeb4fbb2a46d09fd18eaf7de500d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df6e56783b84282be0ca425358015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:34:35 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-749b1c6f-3298-4d2a-a467-472ce2fbded4 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" status: 200 len: 2823 microversion: 2.32 time: 0.472747 Apr 11 15:34:35 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 181/545] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:34:34 2023] GET /compute/v2.1/servers/fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 => generated 2823 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 15:34:35 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-0d38d60e-eb4b-49db-9eaa-5a8f5cdba1e8 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:34:35 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-0d38d60e-eb4b-49db-9eaa-5a8f5cdba1e8 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:34:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0d38d60e-eb4b-49db-9eaa-5a8f5cdba1e8 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0d38d60e-eb4b-49db-9eaa-5a8f5cdba1e8 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0d38d60e-eb4b-49db-9eaa-5a8f5cdba1e8 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0d38d60e-eb4b-49db-9eaa-5a8f5cdba1e8 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0d38d60e-eb4b-49db-9eaa-5a8f5cdba1e8 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0d38d60e-eb4b-49db-9eaa-5a8f5cdba1e8 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:35 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-dde7f617-dee3-45c9-9dc3-10c587014d14 req-35b852de-b8f1-40c3-a727-e5d4bb5b1a0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a805345-374c-4326-9e8f-39bfc7947a35", "name": "network-vif-plugged", "status": "completed", "tag": "d8c64197-b034-4f38-821d-ba030f1fca6b"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:34:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-dde7f617-dee3-45c9-9dc3-10c587014d14 req-35b852de-b8f1-40c3-a727-e5d4bb5b1a0b service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-dde7f617-dee3-45c9-9dc3-10c587014d14 req-35b852de-b8f1-40c3-a727-e5d4bb5b1a0b service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-dde7f617-dee3-45c9-9dc3-10c587014d14 req-35b852de-b8f1-40c3-a727-e5d4bb5b1a0b service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:35 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-dde7f617-dee3-45c9-9dc3-10c587014d14 req-35b852de-b8f1-40c3-a727-e5d4bb5b1a0b service nova] Creating event network-vif-plugged:d8c64197-b034-4f38-821d-ba030f1fca6b for instance 6a805345-374c-4326-9e8f-39bfc7947a35 on user Apr 11 15:34:35 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-0d38d60e-eb4b-49db-9eaa-5a8f5cdba1e8 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fa6dc9c1-6786-4c17-a23e-f71c21ac08a7/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.188000 Apr 11 15:34:35 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 181/546] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 15:34:35 2023] GET /compute/v2.1/servers/fa6dc9c1-6786-4c17-a23e-f71c21ac08a7/os-interface => generated 1830 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:34:35 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-dde7f617-dee3-45c9-9dc3-10c587014d14 req-35b852de-b8f1-40c3-a727-e5d4bb5b1a0b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039221 Apr 11 15:34:35 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 185/547] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:34:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:34:36 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-78f29be7-1e19-4a6f-9d48-6dfd7a6e0f68 req-7df32988-7cce-4f06-b547-bb97a4814ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f34c2249-840e-4475-87e6-648d173bc7ed", "tag": "dc2a981c-9e15-473f-8bd6-c4c312b107d1"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:34:36 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-78f29be7-1e19-4a6f-9d48-6dfd7a6e0f68 req-7df32988-7cce-4f06-b547-bb97a4814ad8 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:36 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-78f29be7-1e19-4a6f-9d48-6dfd7a6e0f68 req-7df32988-7cce-4f06-b547-bb97a4814ad8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:36 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-78f29be7-1e19-4a6f-9d48-6dfd7a6e0f68 req-7df32988-7cce-4f06-b547-bb97a4814ad8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:36 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-78f29be7-1e19-4a6f-9d48-6dfd7a6e0f68 req-7df32988-7cce-4f06-b547-bb97a4814ad8 service nova] Creating event network-changed:dc2a981c-9e15-473f-8bd6-c4c312b107d1 for instance f34c2249-840e-4475-87e6-648d173bc7ed on user Apr 11 15:34:36 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-78f29be7-1e19-4a6f-9d48-6dfd7a6e0f68 req-7df32988-7cce-4f06-b547-bb97a4814ad8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045912 Apr 11 15:34:36 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 182/548] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:34:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:34:36 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-9981651e-85bf-4852-91d8-df86a249a897 req-b0451a3a-ec0a-4975-985c-70893b1bfcbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a805345-374c-4326-9e8f-39bfc7947a35", "name": "network-vif-deleted", "tag": "d8c64197-b034-4f38-821d-ba030f1fca6b"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:34:36 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-9981651e-85bf-4852-91d8-df86a249a897 req-b0451a3a-ec0a-4975-985c-70893b1bfcbe service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:36 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-9981651e-85bf-4852-91d8-df86a249a897 req-b0451a3a-ec0a-4975-985c-70893b1bfcbe service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:36 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-9981651e-85bf-4852-91d8-df86a249a897 req-b0451a3a-ec0a-4975-985c-70893b1bfcbe service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:36 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-9981651e-85bf-4852-91d8-df86a249a897 req-b0451a3a-ec0a-4975-985c-70893b1bfcbe service nova] Creating event network-vif-deleted:d8c64197-b034-4f38-821d-ba030f1fca6b for instance 6a805345-374c-4326-9e8f-39bfc7947a35 on user Apr 11 15:34:36 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-9981651e-85bf-4852-91d8-df86a249a897 req-b0451a3a-ec0a-4975-985c-70893b1bfcbe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029198 Apr 11 15:34:36 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 182/549] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:34:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:34:36 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:34:36 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:34:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:36 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Going to try to terminate instance {{(pid=61167) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:34:37 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" status: 204 len: 0 microversion: 2.32 time: 0.121860 Apr 11 15:34:37 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 186/550] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 15:34:36 2023] DELETE /compute/v2.1/servers/fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 15:34:37 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-5fde576d-5bde-4b66-b349-509eef519060 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:34:37 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-5fde576d-5bde-4b66-b349-509eef519060 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:34:37 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5fde576d-5bde-4b66-b349-509eef519060 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:37 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5fde576d-5bde-4b66-b349-509eef519060 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:37 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5fde576d-5bde-4b66-b349-509eef519060 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:37 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5fde576d-5bde-4b66-b349-509eef519060 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:37 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5fde576d-5bde-4b66-b349-509eef519060 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:37 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5fde576d-5bde-4b66-b349-509eef519060 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:37 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-5fde576d-5bde-4b66-b349-509eef519060 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645eeb4fbb2a46d09fd18eaf7de500d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df6e56783b84282be0ca425358015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:34:37 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-5fde576d-5bde-4b66-b349-509eef519060 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645eeb4fbb2a46d09fd18eaf7de500d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df6e56783b84282be0ca425358015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:34:37 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-5fde576d-5bde-4b66-b349-509eef519060 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645eeb4fbb2a46d09fd18eaf7de500d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df6e56783b84282be0ca425358015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:34:37 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-5fde576d-5bde-4b66-b349-509eef519060 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" status: 200 len: 2947 microversion: 2.32 time: 0.439018 Apr 11 15:34:37 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 183/551] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:34:37 2023] GET /compute/v2.1/servers/fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 => generated 2947 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:34:37 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-02196c7d-c74e-4f75-ae63-4c7a3b59cd04 req-760fa015-0cce-4be1-ba11-76fb79dee745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "name": "network-vif-unplugged", "status": "completed", "tag": "b7d90fa1-965a-4cc7-bc48-64a43041af23"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:34:37 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-ad7eb22c-dc1a-42e2-b0c5-dba9c7d96e25 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] Action: 'create', calling method: .version_select at 0x7f4c2edf4160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-555763314"}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:34:37 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-02196c7d-c74e-4f75-ae63-4c7a3b59cd04 req-760fa015-0cce-4be1-ba11-76fb79dee745 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:37 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-02196c7d-c74e-4f75-ae63-4c7a3b59cd04 req-760fa015-0cce-4be1-ba11-76fb79dee745 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:37 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-02196c7d-c74e-4f75-ae63-4c7a3b59cd04 req-760fa015-0cce-4be1-ba11-76fb79dee745 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:37 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-02196c7d-c74e-4f75-ae63-4c7a3b59cd04 req-760fa015-0cce-4be1-ba11-76fb79dee745 service nova] Creating event network-vif-unplugged:b7d90fa1-965a-4cc7-bc48-64a43041af23 for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:34:37 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-02196c7d-c74e-4f75-ae63-4c7a3b59cd04 req-760fa015-0cce-4be1-ba11-76fb79dee745 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038244 Apr 11 15:34:37 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 187/552] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:34:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:34:38 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-ad7eb22c-dc1a-42e2-b0c5-dba9c7d96e25 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.864982 Apr 11 15:34:38 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 183/553] 10.0.0.210 () {64 vars in 1232 bytes} [Tue Apr 11 15:34:37 2023] POST /compute/v2.1/os-volumes => generated 344 bytes in 867 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 11 15:34:38 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-b8ebf7cf-13b9-498e-85aa-547ad2a82fe6 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] Calling method '.version_select at 0x7f4c2eb3c790>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:34:38 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-b8ebf7cf-13b9-498e-85aa-547ad2a82fe6 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/6c975035-9561-4728-9f96-9f73553acfe8" status: 200 len: 344 microversion: 2.1 time: 0.133968 Apr 11 15:34:38 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 184/554] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 15:34:38 2023] GET /compute/v2.1/os-volumes/6c975035-9561-4728-9f96-9f73553acfe8 => generated 344 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 15:34:38 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-dc2d76d1-6a73-4adb-848c-3477e0f227f4 req-5e44b3ef-3e05-4cb8-b5b7-655cc87e25de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "name": "network-vif-unplugged", "status": "completed", "tag": "fafe4f73-4fc5-401b-a2bf-542bea23915f"}, {"server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "name": "network-vif-plugged", "status": "completed", "tag": "fafe4f73-4fc5-401b-a2bf-542bea23915f"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:34:38 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-dc2d76d1-6a73-4adb-848c-3477e0f227f4 req-5e44b3ef-3e05-4cb8-b5b7-655cc87e25de service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:38 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-dc2d76d1-6a73-4adb-848c-3477e0f227f4 req-5e44b3ef-3e05-4cb8-b5b7-655cc87e25de service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:38 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-dc2d76d1-6a73-4adb-848c-3477e0f227f4 req-5e44b3ef-3e05-4cb8-b5b7-655cc87e25de service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:38 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-dc2d76d1-6a73-4adb-848c-3477e0f227f4 req-5e44b3ef-3e05-4cb8-b5b7-655cc87e25de service nova] Creating event network-vif-unplugged:fafe4f73-4fc5-401b-a2bf-542bea23915f for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:34:38 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-dc2d76d1-6a73-4adb-848c-3477e0f227f4 req-5e44b3ef-3e05-4cb8-b5b7-655cc87e25de service nova] Creating event network-vif-plugged:fafe4f73-4fc5-401b-a2bf-542bea23915f for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:34:38 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-dc2d76d1-6a73-4adb-848c-3477e0f227f4 req-5e44b3ef-3e05-4cb8-b5b7-655cc87e25de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.035791 Apr 11 15:34:38 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 188/555] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:34:38 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:34:38 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-2e34405e-8ca3-4002-be0f-0a3c9ce594b8 req-e75ac03f-67b4-4f12-bd69-3af60c4f8d4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "name": "network-vif-unplugged", "status": "completed", "tag": "7485c140-3c08-4191-9929-3c41cb6fd725"}, {"server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "name": "network-vif-plugged", "status": "completed", "tag": "7485c140-3c08-4191-9929-3c41cb6fd725"}, {"server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "name": "network-vif-unplugged", "status": "completed", "tag": "bf63f34a-3145-4251-a036-a35bd08ef45f"}, {"server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "name": "network-vif-plugged", "status": "completed", "tag": "bf63f34a-3145-4251-a036-a35bd08ef45f"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:34:38 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-2e34405e-8ca3-4002-be0f-0a3c9ce594b8 req-e75ac03f-67b4-4f12-bd69-3af60c4f8d4b service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:38 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-2e34405e-8ca3-4002-be0f-0a3c9ce594b8 req-e75ac03f-67b4-4f12-bd69-3af60c4f8d4b service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:38 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-2e34405e-8ca3-4002-be0f-0a3c9ce594b8 req-e75ac03f-67b4-4f12-bd69-3af60c4f8d4b service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:38 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-2e34405e-8ca3-4002-be0f-0a3c9ce594b8 req-e75ac03f-67b4-4f12-bd69-3af60c4f8d4b service nova] Creating event network-vif-unplugged:7485c140-3c08-4191-9929-3c41cb6fd725 for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:34:38 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-2e34405e-8ca3-4002-be0f-0a3c9ce594b8 req-e75ac03f-67b4-4f12-bd69-3af60c4f8d4b service nova] Creating event network-vif-plugged:7485c140-3c08-4191-9929-3c41cb6fd725 for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:34:38 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-2e34405e-8ca3-4002-be0f-0a3c9ce594b8 req-e75ac03f-67b4-4f12-bd69-3af60c4f8d4b service nova] Creating event network-vif-unplugged:bf63f34a-3145-4251-a036-a35bd08ef45f for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:34:38 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-2e34405e-8ca3-4002-be0f-0a3c9ce594b8 req-e75ac03f-67b4-4f12-bd69-3af60c4f8d4b service nova] Creating event network-vif-plugged:bf63f34a-3145-4251-a036-a35bd08ef45f for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:34:38 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-2e34405e-8ca3-4002-be0f-0a3c9ce594b8 req-e75ac03f-67b4-4f12-bd69-3af60c4f8d4b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 700 microversion: 2.1 time: 0.044652 Apr 11 15:34:38 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 184/556] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:34:38 2023] POST /compute/v2.1/os-server-external-events => generated 700 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:34:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-11859a76-b675-464b-905c-29684e83d184 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] Calling method '.version_select at 0x7f4c2eb3ca60>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:34:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-65030836-46cd-4d01-979d-16508e05124f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:34:39 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-65030836-46cd-4d01-979d-16508e05124f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:34:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-65030836-46cd-4d01-979d-16508e05124f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-65030836-46cd-4d01-979d-16508e05124f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-65030836-46cd-4d01-979d-16508e05124f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-65030836-46cd-4d01-979d-16508e05124f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-65030836-46cd-4d01-979d-16508e05124f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-65030836-46cd-4d01-979d-16508e05124f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:39 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-65030836-46cd-4d01-979d-16508e05124f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] HTTP exception thrown: Instance d534d17d-ba77-4447-8a63-7d6021ad7896 could not be found. Apr 11 15:34:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-65030836-46cd-4d01-979d-16508e05124f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Request method failure captured: Apr 11 15:34:39 user devstack@n-api.service[61167]: request: GET /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896 HTTP/1.1 Apr 11 15:34:39 user devstack@n-api.service[61167]: Accept: application/json Apr 11 15:34:39 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 15:34:39 user devstack@n-api.service[61167]: Connection: close Apr 11 15:34:39 user devstack@n-api.service[61167]: Content-Length: 0 Apr 11 15:34:39 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 15:34:39 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 15:34:39 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 15:34:39 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 15:34:39 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNXxlXAJYTyMelh64LqZnQxfN2XKy_zSvvv3rrb0nGuyits6evuYLdcUCont3Kb3D0W_ZgUOWSwxTBJqTvOpfdwZEK_VtgF8vNxXw0qg0q-A8zgeYKf929ywc9LtGUjjQn1j3gJjVk3_gWIP9K7sCEnRAusvWzNN6HF4f8_p86bAgYvA Apr 11 15:34:39 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 15:34:39 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 15:34:39 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 15:34:39 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 15:34:39 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 15:34:39 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 15:34:39 user devstack@n-api.service[61167]: X-Project-Id: 90bfd48094c54cd5b13dabf27ebdd5dd Apr 11 15:34:39 user devstack@n-api.service[61167]: X-Project-Name: tempest-SnapshotDataIntegrityTests-1684503145 Apr 11 15:34:39 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 15:34:39 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 15:34:39 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/90bfd48094c54cd5b13dabf27ebdd5dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/90bfd48094c54cd5b13dabf27ebdd5dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/90bfd48094c54cd5b13dabf27ebdd5dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:34:39 user devstack@n-api.service[61167]: X-Tenant: tempest-SnapshotDataIntegrityTests-1684503145 Apr 11 15:34:39 user devstack@n-api.service[61167]: X-Tenant-Id: 90bfd48094c54cd5b13dabf27ebdd5dd Apr 11 15:34:39 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-1684503145 Apr 11 15:34:39 user devstack@n-api.service[61167]: X-User: tempest-SnapshotDataIntegrityTests-1684503145-project-member Apr 11 15:34:39 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 15:34:39 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 15:34:39 user devstack@n-api.service[61167]: X-User-Id: 091ece3baa634583a7cc3000c78f2c26 Apr 11 15:34:39 user devstack@n-api.service[61167]: X-User-Name: tempest-SnapshotDataIntegrityTests-1684503145-project-member Apr 11 15:34:39 user devstack@n-api.service[61167]: method: > Apr 11 15:34:39 user devstack@n-api.service[61167]: exception: Instance d534d17d-ba77-4447-8a63-7d6021ad7896 could not be found. Apr 11 15:34:39 user devstack@n-api.service[61167]: action_args: {'id': 'd534d17d-ba77-4447-8a63-7d6021ad7896'} Apr 11 15:34:39 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d534d17d-ba77-4447-8a63-7d6021ad7896 could not be found. Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d534d17d-ba77-4447-8a63-7d6021ad7896 could not be found. Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d534d17d-ba77-4447-8a63-7d6021ad7896 could not be found. Apr 11 15:34:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:34:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-65030836-46cd-4d01-979d-16508e05124f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Returning 404 to user: Instance d534d17d-ba77-4447-8a63-7d6021ad7896 could not be found. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:34:39 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-65030836-46cd-4d01-979d-16508e05124f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896" status: 404 len: 111 microversion: 2.1 time: 0.035917 Apr 11 15:34:39 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 189/557] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:34:39 2023] GET /compute/v2.1/servers/d534d17d-ba77-4447-8a63-7d6021ad7896 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:34:39 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-11859a76-b675-464b-905c-29684e83d184 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/6c975035-9561-4728-9f96-9f73553acfe8" status: 200 len: 345 microversion: 2.1 time: 0.071901 Apr 11 15:34:39 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 185/558] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 15:34:39 2023] GET /compute/v2.1/os-volumes/6c975035-9561-4728-9f96-9f73553acfe8 => generated 345 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:34:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-b28cfcb4-6abd-4192-b2ee-74a9d6e2e3bf tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] Action: 'create', calling method: .version_select at 0x7f4c2ec69510>, body: {"snapshot": {"volume_id": "6c975035-9561-4728-9f96-9f73553acfe8", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1969526092"}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:34:39 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-b28cfcb4-6abd-4192-b2ee-74a9d6e2e3bf tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.228434 Apr 11 15:34:39 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 185/559] 10.0.0.210 () {64 vars in 1239 bytes} [Tue Apr 11 15:34:39 2023] POST /compute/v2.1/os-snapshots => generated 287 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:34:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-041f8bcc-5d98-4489-a5d4-7e2b33a0f447 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] Calling method '.version_select at 0x7f4c2edfa7a0>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:34:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "name": "network-vif-plugged", "status": "completed", "tag": "b7d90fa1-965a-4cc7-bc48-64a43041af23"}, {"server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "name": "network-vif-unplugged", "status": "completed", "tag": "44becdbc-fa86-4dbe-ac1a-e0e01648513b"}, {"server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "name": "network-vif-plugged", "status": "completed", "tag": "44becdbc-fa86-4dbe-ac1a-e0e01648513b"}, {"server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "name": "network-vif-unplugged", "status": "completed", "tag": "e5066fdb-ea6f-4df5-b185-56f1a0dbe539"}, {"server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "name": "network-vif-plugged", "status": "completed", "tag": "e5066fdb-ea6f-4df5-b185-56f1a0dbe539"}, {"server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "name": "network-vif-unplugged", "status": "completed", "tag": "b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f"}, {"server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "name": "network-vif-plugged", "status": "completed", "tag": "b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:34:39 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:39 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:39 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:39 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-041f8bcc-5d98-4489-a5d4-7e2b33a0f447 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/3cf50b83-ee1e-4be9-97b9-4ed7a7502e61" status: 200 len: 287 microversion: 2.1 time: 0.089127 Apr 11 15:34:39 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 190/560] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 15:34:39 2023] GET /compute/v2.1/os-snapshots/3cf50b83-ee1e-4be9-97b9-4ed7a7502e61 => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:34:39 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] Creating event network-vif-plugged:b7d90fa1-965a-4cc7-bc48-64a43041af23 for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:34:39 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] Creating event network-vif-unplugged:44becdbc-fa86-4dbe-ac1a-e0e01648513b for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:34:39 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] Creating event network-vif-plugged:44becdbc-fa86-4dbe-ac1a-e0e01648513b for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:34:39 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] Creating event network-vif-unplugged:e5066fdb-ea6f-4df5-b185-56f1a0dbe539 for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:34:39 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] Creating event network-vif-plugged:e5066fdb-ea6f-4df5-b185-56f1a0dbe539 for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:34:39 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] Creating event network-vif-unplugged:b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:34:39 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] Creating event network-vif-plugged:b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:34:39 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1215 microversion: 2.1 time: 0.038652 Apr 11 15:34:39 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 186/561] 10.0.0.210 () {68 vars in 1395 bytes} [Tue Apr 11 15:34:39 2023] POST /compute/v2.1/os-server-external-events => generated 1215 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:34:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-ba891469-6f86-4060-b103-ad31ef522d30 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] Calling method '.version_select at 0x7f4c2ec6ad40>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:34:39 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-ba891469-6f86-4060-b103-ad31ef522d30 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.041962 Apr 11 15:34:39 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 186/562] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Apr 11 15:34:39 2023] GET /compute/v2.1/os-snapshots => generated 290 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:34:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-0d7e089e-f080-4cc3-8091-d5a16ef80291 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] Calling method '.version_select at 0x7f4c2ecd92d0>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:34:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-533f09f8-b0b6-425a-ac81-a48cb4a5f8e9 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Calling method '.version_select at 0x7f4c2ef2d900>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:34:39 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-0d7e089e-f080-4cc3-8091-d5a16ef80291 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/3cf50b83-ee1e-4be9-97b9-4ed7a7502e61" status: 200 len: 287 microversion: 2.1 time: 0.055864 Apr 11 15:34:39 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 191/563] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 15:34:39 2023] GET /compute/v2.1/os-snapshots/3cf50b83-ee1e-4be9-97b9-4ed7a7502e61 => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:34:39 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-533f09f8-b0b6-425a-ac81-a48cb4a5f8e9 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-465777949" status: 202 len: 0 microversion: 2.1 time: 0.029822 Apr 11 15:34:39 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 187/564] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 15:34:39 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-465777949 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:34:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-5e339efe-695b-49e5-a387-f903dd366800 req-7e312ad9-0d9a-438e-ad85-ec5b9fdc541b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f34c2249-840e-4475-87e6-648d173bc7ed", "name": "network-vif-plugged", "status": "completed", "tag": "dc2a981c-9e15-473f-8bd6-c4c312b107d1"}, {"server_uuid": "f34c2249-840e-4475-87e6-648d173bc7ed", "name": "network-vif-plugged", "status": "completed", "tag": "dc2a981c-9e15-473f-8bd6-c4c312b107d1"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:34:40 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=21 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:34:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-5e339efe-695b-49e5-a387-f903dd366800 req-7e312ad9-0d9a-438e-ad85-ec5b9fdc541b service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-5e339efe-695b-49e5-a387-f903dd366800 req-7e312ad9-0d9a-438e-ad85-ec5b9fdc541b service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-5e339efe-695b-49e5-a387-f903dd366800 req-7e312ad9-0d9a-438e-ad85-ec5b9fdc541b service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:40 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=27 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:34:40 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-5e339efe-695b-49e5-a387-f903dd366800 req-7e312ad9-0d9a-438e-ad85-ec5b9fdc541b service nova] Creating event network-vif-plugged:dc2a981c-9e15-473f-8bd6-c4c312b107d1 for instance f34c2249-840e-4475-87e6-648d173bc7ed on user Apr 11 15:34:40 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-5e339efe-695b-49e5-a387-f903dd366800 req-7e312ad9-0d9a-438e-ad85-ec5b9fdc541b service nova] Creating event network-vif-plugged:dc2a981c-9e15-473f-8bd6-c4c312b107d1 for instance f34c2249-840e-4475-87e6-648d173bc7ed on user Apr 11 15:34:40 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-5e339efe-695b-49e5-a387-f903dd366800 req-7e312ad9-0d9a-438e-ad85-ec5b9fdc541b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034155 Apr 11 15:34:40 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 187/565] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:34:40 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:34:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-1e1dd598-cbe8-4304-94fd-d7c21b7d4fb8 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] Calling method '.version_select at 0x7f4c2ed6fb50>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:34:41 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-1e1dd598-cbe8-4304-94fd-d7c21b7d4fb8 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/3cf50b83-ee1e-4be9-97b9-4ed7a7502e61" status: 200 len: 288 microversion: 2.1 time: 0.033803 Apr 11 15:34:41 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 192/566] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 15:34:40 2023] GET /compute/v2.1/os-snapshots/3cf50b83-ee1e-4be9-97b9-4ed7a7502e61 => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:34:41 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-458afdf8-9ecb-4083-8925-bede5d488701 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] Calling method '.version_select at 0x7f4c2eb3fa30>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:34:41 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-458afdf8-9ecb-4083-8925-bede5d488701 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/3cf50b83-ee1e-4be9-97b9-4ed7a7502e61" status: 202 len: 0 microversion: 2.1 time: 0.072421 Apr 11 15:34:41 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 188/567] 10.0.0.210 () {62 vars in 1331 bytes} [Tue Apr 11 15:34:41 2023] DELETE /compute/v2.1/os-snapshots/3cf50b83-ee1e-4be9-97b9-4ed7a7502e61 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:34:41 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-f57629f0-87a8-4e85-a9c2-33783dd62c54 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] Calling method '.version_select at 0x7f4c2edf5480>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:34:41 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-f57629f0-87a8-4e85-a9c2-33783dd62c54 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/3cf50b83-ee1e-4be9-97b9-4ed7a7502e61" status: 200 len: 287 microversion: 2.1 time: 0.040605 Apr 11 15:34:41 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 188/568] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 15:34:41 2023] GET /compute/v2.1/os-snapshots/3cf50b83-ee1e-4be9-97b9-4ed7a7502e61 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:34:42 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-d2899ba1-23f4-49f3-b4d3-f8df289bc1c6 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] Calling method '.version_select at 0x7f4c2edf9990>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:34:42 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-d2899ba1-23f4-49f3-b4d3-f8df289bc1c6 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] HTTP exception thrown: Snapshot 3cf50b83-ee1e-4be9-97b9-4ed7a7502e61 could not be found. Apr 11 15:34:42 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-d2899ba1-23f4-49f3-b4d3-f8df289bc1c6 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] Request method failure captured: Apr 11 15:34:42 user devstack@n-api.service[61167]: request: GET /compute/v2.1/os-snapshots/3cf50b83-ee1e-4be9-97b9-4ed7a7502e61 HTTP/1.1 Apr 11 15:34:42 user devstack@n-api.service[61167]: Accept: application/json Apr 11 15:34:42 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 15:34:42 user devstack@n-api.service[61167]: Connection: close Apr 11 15:34:42 user devstack@n-api.service[61167]: Content-Length: 0 Apr 11 15:34:42 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 15:34:42 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 15:34:42 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 15:34:42 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 15:34:42 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNX4NCu9csUTHD_W3_GdUbpxVEyXvCyl9mAv2mZr9UmPO37cekS6fn8FIRqSolWg97AFwtrn1ErZ6n31TN1f_CI6NPpn18vLmF2FyQkx5N2OlN-j8dAZD6scsBbAj0RL1JFXaqT70ruBFCjWLW-3HFMntxgXKBWf1wZUSuknT9-razCw Apr 11 15:34:42 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 15:34:42 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 15:34:42 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 15:34:42 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 15:34:42 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 15:34:42 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 15:34:42 user devstack@n-api.service[61167]: X-Project-Id: 3dd44d43d5a74d83a13e6565662d6a3f Apr 11 15:34:42 user devstack@n-api.service[61167]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-801748228 Apr 11 15:34:42 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 15:34:42 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 15:34:42 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3dd44d43d5a74d83a13e6565662d6a3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3dd44d43d5a74d83a13e6565662d6a3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3dd44d43d5a74d83a13e6565662d6a3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:34:42 user devstack@n-api.service[61167]: X-Tenant: tempest-VolumesSnapshotsTestJSON-801748228 Apr 11 15:34:42 user devstack@n-api.service[61167]: X-Tenant-Id: 3dd44d43d5a74d83a13e6565662d6a3f Apr 11 15:34:42 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-801748228 Apr 11 15:34:42 user devstack@n-api.service[61167]: X-User: tempest-VolumesSnapshotsTestJSON-801748228-project-member Apr 11 15:34:42 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 15:34:42 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 15:34:42 user devstack@n-api.service[61167]: X-User-Id: 95336074c676458ebc98ab5439c92e49 Apr 11 15:34:42 user devstack@n-api.service[61167]: X-User-Name: tempest-VolumesSnapshotsTestJSON-801748228-project-member Apr 11 15:34:42 user devstack@n-api.service[61167]: method: Apr 11 15:34:42 user devstack@n-api.service[61167]: exception: Snapshot 3cf50b83-ee1e-4be9-97b9-4ed7a7502e61 could not be found. Apr 11 15:34:42 user devstack@n-api.service[61167]: action_args: {'id': '3cf50b83-ee1e-4be9-97b9-4ed7a7502e61'} Apr 11 15:34:42 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3cf50b83-ee1e-4be9-97b9-4ed7a7502e61 could not be found. (HTTP 404) (Request-ID: req-b95189bc-bfc0-44a1-8bce-037d659742b7) Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3cf50b83-ee1e-4be9-97b9-4ed7a7502e61 could not be found. Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3cf50b83-ee1e-4be9-97b9-4ed7a7502e61 could not be found. Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3cf50b83-ee1e-4be9-97b9-4ed7a7502e61 could not be found. Apr 11 15:34:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:34:42 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-d2899ba1-23f4-49f3-b4d3-f8df289bc1c6 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] Returning 404 to user: Snapshot 3cf50b83-ee1e-4be9-97b9-4ed7a7502e61 could not be found. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:34:42 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-d2899ba1-23f4-49f3-b4d3-f8df289bc1c6 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/3cf50b83-ee1e-4be9-97b9-4ed7a7502e61" status: 404 len: 111 microversion: 2.1 time: 0.035604 Apr 11 15:34:42 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 193/569] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 15:34:42 2023] GET /compute/v2.1/os-snapshots/3cf50b83-ee1e-4be9-97b9-4ed7a7502e61 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:34:42 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-2302255d-de82-4aa5-b915-ce970c149575 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] Calling method '.version_select at 0x7f4c2ecab5b0>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:34:42 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-2302255d-de82-4aa5-b915-ce970c149575 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/6c975035-9561-4728-9f96-9f73553acfe8" status: 202 len: 0 microversion: 2.1 time: 0.062584 Apr 11 15:34:42 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 189/570] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 15:34:42 2023] DELETE /compute/v2.1/os-volumes/6c975035-9561-4728-9f96-9f73553acfe8 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:34:42 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-2cb46153-8896-4087-ba5b-149037753b26 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] Calling method '.version_select at 0x7f4c2edf4790>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:34:42 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-2cb46153-8896-4087-ba5b-149037753b26 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/6c975035-9561-4728-9f96-9f73553acfe8" status: 200 len: 344 microversion: 2.1 time: 0.061655 Apr 11 15:34:42 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 189/571] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 15:34:42 2023] GET /compute/v2.1/os-volumes/6c975035-9561-4728-9f96-9f73553acfe8 => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:34:43 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:34:43 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:34:43 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-84f758ad-bedc-4844-a0cf-c5b2e633036b req-c5dbdbbe-2e31-4e04-9753-003dd561b90d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "name": "network-vif-deleted", "tag": "b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:34:43 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-84f758ad-bedc-4844-a0cf-c5b2e633036b req-c5dbdbbe-2e31-4e04-9753-003dd561b90d service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:43 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-84f758ad-bedc-4844-a0cf-c5b2e633036b req-c5dbdbbe-2e31-4e04-9753-003dd561b90d service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:43 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-84f758ad-bedc-4844-a0cf-c5b2e633036b req-c5dbdbbe-2e31-4e04-9753-003dd561b90d service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:43 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-84f758ad-bedc-4844-a0cf-c5b2e633036b req-c5dbdbbe-2e31-4e04-9753-003dd561b90d service nova] Creating event network-vif-deleted:b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:34:43 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-84f758ad-bedc-4844-a0cf-c5b2e633036b req-c5dbdbbe-2e31-4e04-9753-003dd561b90d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045623 Apr 11 15:34:43 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 194/572] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:34:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:34:43 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-1cccca3b-018e-4853-a1d8-33bf3ca2fe79 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] Calling method '.version_select at 0x7f4c2eb3c0d0>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:34:43 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-1cccca3b-018e-4853-a1d8-33bf3ca2fe79 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] HTTP exception thrown: Volume 6c975035-9561-4728-9f96-9f73553acfe8 could not be found. Apr 11 15:34:43 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-1cccca3b-018e-4853-a1d8-33bf3ca2fe79 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] Request method failure captured: Apr 11 15:34:43 user devstack@n-api.service[61165]: request: GET /compute/v2.1/os-volumes/6c975035-9561-4728-9f96-9f73553acfe8 HTTP/1.1 Apr 11 15:34:43 user devstack@n-api.service[61165]: Accept: application/json Apr 11 15:34:43 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 15:34:43 user devstack@n-api.service[61165]: Connection: close Apr 11 15:34:43 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 15:34:43 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 15:34:43 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 15:34:43 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 15:34:43 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 15:34:43 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNX4NCu9csUTHD_W3_GdUbpxVEyXvCyl9mAv2mZr9UmPO37cekS6fn8FIRqSolWg97AFwtrn1ErZ6n31TN1f_CI6NPpn18vLmF2FyQkx5N2OlN-j8dAZD6scsBbAj0RL1JFXaqT70ruBFCjWLW-3HFMntxgXKBWf1wZUSuknT9-razCw Apr 11 15:34:43 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 15:34:43 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 15:34:43 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 15:34:43 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 15:34:43 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 15:34:43 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 15:34:43 user devstack@n-api.service[61165]: X-Project-Id: 3dd44d43d5a74d83a13e6565662d6a3f Apr 11 15:34:43 user devstack@n-api.service[61165]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-801748228 Apr 11 15:34:43 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 15:34:43 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 15:34:43 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3dd44d43d5a74d83a13e6565662d6a3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3dd44d43d5a74d83a13e6565662d6a3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3dd44d43d5a74d83a13e6565662d6a3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:34:43 user devstack@n-api.service[61165]: X-Tenant: tempest-VolumesSnapshotsTestJSON-801748228 Apr 11 15:34:43 user devstack@n-api.service[61165]: X-Tenant-Id: 3dd44d43d5a74d83a13e6565662d6a3f Apr 11 15:34:43 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-801748228 Apr 11 15:34:43 user devstack@n-api.service[61165]: X-User: tempest-VolumesSnapshotsTestJSON-801748228-project-member Apr 11 15:34:43 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 15:34:43 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 15:34:43 user devstack@n-api.service[61165]: X-User-Id: 95336074c676458ebc98ab5439c92e49 Apr 11 15:34:43 user devstack@n-api.service[61165]: X-User-Name: tempest-VolumesSnapshotsTestJSON-801748228-project-member Apr 11 15:34:43 user devstack@n-api.service[61165]: method: Apr 11 15:34:43 user devstack@n-api.service[61165]: exception: Volume 6c975035-9561-4728-9f96-9f73553acfe8 could not be found. Apr 11 15:34:43 user devstack@n-api.service[61165]: action_args: {'id': '6c975035-9561-4728-9f96-9f73553acfe8'} Apr 11 15:34:43 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6c975035-9561-4728-9f96-9f73553acfe8 could not be found. (HTTP 404) (Request-ID: req-897d23c4-5e7c-4ff2-bef3-9e917224e854) Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6c975035-9561-4728-9f96-9f73553acfe8 could not be found. Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6c975035-9561-4728-9f96-9f73553acfe8 could not be found. Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6c975035-9561-4728-9f96-9f73553acfe8 could not be found. Apr 11 15:34:43 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:34:43 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-1cccca3b-018e-4853-a1d8-33bf3ca2fe79 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] Returning 404 to user: Volume 6c975035-9561-4728-9f96-9f73553acfe8 could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:34:43 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-1cccca3b-018e-4853-a1d8-33bf3ca2fe79 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/6c975035-9561-4728-9f96-9f73553acfe8" status: 404 len: 109 microversion: 2.1 time: 0.045022 Apr 11 15:34:43 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 190/573] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 15:34:43 2023] GET /compute/v2.1/os-volumes/6c975035-9561-4728-9f96-9f73553acfe8 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:34:43 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-81aa1fac-ce64-4884-a6a7-120fe096c03e tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] Calling method '.version_select at 0x7f4c2eff7400>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:34:43 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:34:43 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-81aa1fac-ce64-4884-a6a7-120fe096c03e tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] HTTP exception thrown: Volume 6c975035-9561-4728-9f96-9f73553acfe8 could not be found. Apr 11 15:34:43 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-81aa1fac-ce64-4884-a6a7-120fe096c03e tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] Request method failure captured: Apr 11 15:34:43 user devstack@n-api.service[61166]: request: DELETE /compute/v2.1/os-volumes/6c975035-9561-4728-9f96-9f73553acfe8 HTTP/1.1 Apr 11 15:34:43 user devstack@n-api.service[61166]: Accept: application/json Apr 11 15:34:43 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 15:34:43 user devstack@n-api.service[61166]: Connection: close Apr 11 15:34:43 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 15:34:43 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 15:34:43 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 15:34:43 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 15:34:43 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 15:34:43 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNX4NCu9csUTHD_W3_GdUbpxVEyXvCyl9mAv2mZr9UmPO37cekS6fn8FIRqSolWg97AFwtrn1ErZ6n31TN1f_CI6NPpn18vLmF2FyQkx5N2OlN-j8dAZD6scsBbAj0RL1JFXaqT70ruBFCjWLW-3HFMntxgXKBWf1wZUSuknT9-razCw Apr 11 15:34:43 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 15:34:43 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 15:34:43 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 15:34:43 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 15:34:43 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 15:34:43 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 15:34:43 user devstack@n-api.service[61166]: X-Project-Id: 3dd44d43d5a74d83a13e6565662d6a3f Apr 11 15:34:43 user devstack@n-api.service[61166]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-801748228 Apr 11 15:34:43 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 15:34:43 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 15:34:43 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3dd44d43d5a74d83a13e6565662d6a3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3dd44d43d5a74d83a13e6565662d6a3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3dd44d43d5a74d83a13e6565662d6a3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:34:43 user devstack@n-api.service[61166]: X-Tenant: tempest-VolumesSnapshotsTestJSON-801748228 Apr 11 15:34:43 user devstack@n-api.service[61166]: X-Tenant-Id: 3dd44d43d5a74d83a13e6565662d6a3f Apr 11 15:34:43 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-801748228 Apr 11 15:34:43 user devstack@n-api.service[61166]: X-User: tempest-VolumesSnapshotsTestJSON-801748228-project-member Apr 11 15:34:43 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 15:34:43 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 15:34:43 user devstack@n-api.service[61166]: X-User-Id: 95336074c676458ebc98ab5439c92e49 Apr 11 15:34:43 user devstack@n-api.service[61166]: X-User-Name: tempest-VolumesSnapshotsTestJSON-801748228-project-member Apr 11 15:34:43 user devstack@n-api.service[61166]: method: Apr 11 15:34:43 user devstack@n-api.service[61166]: exception: Volume 6c975035-9561-4728-9f96-9f73553acfe8 could not be found. Apr 11 15:34:43 user devstack@n-api.service[61166]: action_args: {'id': '6c975035-9561-4728-9f96-9f73553acfe8'} Apr 11 15:34:43 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6c975035-9561-4728-9f96-9f73553acfe8 could not be found. (HTTP 404) (Request-ID: req-823afd70-23a7-4169-9913-4c4d35ca9a23) Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6c975035-9561-4728-9f96-9f73553acfe8 could not be found. Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6c975035-9561-4728-9f96-9f73553acfe8 could not be found. Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6c975035-9561-4728-9f96-9f73553acfe8 could not be found. Apr 11 15:34:43 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:34:43 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-81aa1fac-ce64-4884-a6a7-120fe096c03e tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] Returning 404 to user: Volume 6c975035-9561-4728-9f96-9f73553acfe8 could not be found. {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:34:43 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-81aa1fac-ce64-4884-a6a7-120fe096c03e tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/6c975035-9561-4728-9f96-9f73553acfe8" status: 404 len: 109 microversion: 2.1 time: 0.040438 Apr 11 15:34:43 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 190/574] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 15:34:43 2023] DELETE /compute/v2.1/os-volumes/6c975035-9561-4728-9f96-9f73553acfe8 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:34:43 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-4ee8df12-1c74-4e5e-b431-6ce999727131 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] Calling method '.version_select at 0x7f4c2ecd97e0>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:34:43 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-4ee8df12-1c74-4e5e-b431-6ce999727131 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] HTTP exception thrown: Volume 6c975035-9561-4728-9f96-9f73553acfe8 could not be found. Apr 11 15:34:43 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-4ee8df12-1c74-4e5e-b431-6ce999727131 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] Request method failure captured: Apr 11 15:34:43 user devstack@n-api.service[61167]: request: GET /compute/v2.1/os-volumes/6c975035-9561-4728-9f96-9f73553acfe8 HTTP/1.1 Apr 11 15:34:43 user devstack@n-api.service[61167]: Accept: application/json Apr 11 15:34:43 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 15:34:43 user devstack@n-api.service[61167]: Connection: close Apr 11 15:34:43 user devstack@n-api.service[61167]: Content-Length: 0 Apr 11 15:34:43 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 15:34:43 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 15:34:43 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 15:34:43 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 15:34:43 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNX4NCu9csUTHD_W3_GdUbpxVEyXvCyl9mAv2mZr9UmPO37cekS6fn8FIRqSolWg97AFwtrn1ErZ6n31TN1f_CI6NPpn18vLmF2FyQkx5N2OlN-j8dAZD6scsBbAj0RL1JFXaqT70ruBFCjWLW-3HFMntxgXKBWf1wZUSuknT9-razCw Apr 11 15:34:43 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 15:34:43 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 15:34:43 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 15:34:43 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 15:34:43 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 15:34:43 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 15:34:43 user devstack@n-api.service[61167]: X-Project-Id: 3dd44d43d5a74d83a13e6565662d6a3f Apr 11 15:34:43 user devstack@n-api.service[61167]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-801748228 Apr 11 15:34:43 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 15:34:43 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 15:34:43 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3dd44d43d5a74d83a13e6565662d6a3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3dd44d43d5a74d83a13e6565662d6a3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3dd44d43d5a74d83a13e6565662d6a3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:34:43 user devstack@n-api.service[61167]: X-Tenant: tempest-VolumesSnapshotsTestJSON-801748228 Apr 11 15:34:43 user devstack@n-api.service[61167]: X-Tenant-Id: 3dd44d43d5a74d83a13e6565662d6a3f Apr 11 15:34:43 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-801748228 Apr 11 15:34:43 user devstack@n-api.service[61167]: X-User: tempest-VolumesSnapshotsTestJSON-801748228-project-member Apr 11 15:34:43 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 15:34:43 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 15:34:43 user devstack@n-api.service[61167]: X-User-Id: 95336074c676458ebc98ab5439c92e49 Apr 11 15:34:43 user devstack@n-api.service[61167]: X-User-Name: tempest-VolumesSnapshotsTestJSON-801748228-project-member Apr 11 15:34:43 user devstack@n-api.service[61167]: method: Apr 11 15:34:43 user devstack@n-api.service[61167]: exception: Volume 6c975035-9561-4728-9f96-9f73553acfe8 could not be found. Apr 11 15:34:43 user devstack@n-api.service[61167]: action_args: {'id': '6c975035-9561-4728-9f96-9f73553acfe8'} Apr 11 15:34:43 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6c975035-9561-4728-9f96-9f73553acfe8 could not be found. (HTTP 404) (Request-ID: req-d2e53dd8-2313-4088-aed7-89ca6d321d95) Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6c975035-9561-4728-9f96-9f73553acfe8 could not be found. Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6c975035-9561-4728-9f96-9f73553acfe8 could not be found. Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6c975035-9561-4728-9f96-9f73553acfe8 could not be found. Apr 11 15:34:43 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:34:43 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-4ee8df12-1c74-4e5e-b431-6ce999727131 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] Returning 404 to user: Volume 6c975035-9561-4728-9f96-9f73553acfe8 could not be found. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:34:43 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-4ee8df12-1c74-4e5e-b431-6ce999727131 tempest-VolumesSnapshotsTestJSON-801748228 tempest-VolumesSnapshotsTestJSON-801748228-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/6c975035-9561-4728-9f96-9f73553acfe8" status: 404 len: 109 microversion: 2.1 time: 0.055194 Apr 11 15:34:43 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 195/575] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 15:34:43 2023] GET /compute/v2.1/os-volumes/6c975035-9561-4728-9f96-9f73553acfe8 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:34:45 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-1b013d06-8606-445b-9ea5-a26a49e95035 req-31889860-bdb1-4f16-9fdd-dbafc5db4a70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "name": "network-vif-deleted", "tag": "e5066fdb-ea6f-4df5-b185-56f1a0dbe539"}, {"server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "name": "network-vif-deleted", "tag": "7485c140-3c08-4191-9929-3c41cb6fd725"}, {"server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "name": "network-vif-deleted", "tag": "bf63f34a-3145-4251-a036-a35bd08ef45f"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:34:45 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-1b013d06-8606-445b-9ea5-a26a49e95035 req-31889860-bdb1-4f16-9fdd-dbafc5db4a70 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:45 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-1b013d06-8606-445b-9ea5-a26a49e95035 req-31889860-bdb1-4f16-9fdd-dbafc5db4a70 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:45 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-1b013d06-8606-445b-9ea5-a26a49e95035 req-31889860-bdb1-4f16-9fdd-dbafc5db4a70 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:45 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-1b013d06-8606-445b-9ea5-a26a49e95035 req-31889860-bdb1-4f16-9fdd-dbafc5db4a70 service nova] Creating event network-vif-deleted:e5066fdb-ea6f-4df5-b185-56f1a0dbe539 for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:34:45 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-1b013d06-8606-445b-9ea5-a26a49e95035 req-31889860-bdb1-4f16-9fdd-dbafc5db4a70 service nova] Creating event network-vif-deleted:7485c140-3c08-4191-9929-3c41cb6fd725 for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:34:45 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-1b013d06-8606-445b-9ea5-a26a49e95035 req-31889860-bdb1-4f16-9fdd-dbafc5db4a70 service nova] Creating event network-vif-deleted:bf63f34a-3145-4251-a036-a35bd08ef45f for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:34:45 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-1b013d06-8606-445b-9ea5-a26a49e95035 req-31889860-bdb1-4f16-9fdd-dbafc5db4a70 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.037584 Apr 11 15:34:45 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 191/576] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:34:45 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:34:47 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-7e10fd6c-c446-47a8-9f28-b52ad9d3b89e req-0d3f5f64-b1e5-4e07-9721-fd63011d2129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7", "name": "network-vif-deleted", "tag": "44becdbc-fa86-4dbe-ac1a-e0e01648513b"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:34:47 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-7e10fd6c-c446-47a8-9f28-b52ad9d3b89e req-0d3f5f64-b1e5-4e07-9721-fd63011d2129 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:34:47 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-7e10fd6c-c446-47a8-9f28-b52ad9d3b89e req-0d3f5f64-b1e5-4e07-9721-fd63011d2129 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:34:47 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-7e10fd6c-c446-47a8-9f28-b52ad9d3b89e req-0d3f5f64-b1e5-4e07-9721-fd63011d2129 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:34:47 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-7e10fd6c-c446-47a8-9f28-b52ad9d3b89e req-0d3f5f64-b1e5-4e07-9721-fd63011d2129 service nova] Creating event network-vif-deleted:44becdbc-fa86-4dbe-ac1a-e0e01648513b for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 on user Apr 11 15:34:47 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-7e10fd6c-c446-47a8-9f28-b52ad9d3b89e req-0d3f5f64-b1e5-4e07-9721-fd63011d2129 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061906 Apr 11 15:34:47 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 191/577] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:34:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:35:07 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:35:07 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:35:07 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-301ecde0-c413-412f-bfa9-301d3baf1182 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:35:07 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-301ecde0-c413-412f-bfa9-301d3baf1182 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:35:07 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-301ecde0-c413-412f-bfa9-301d3baf1182 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:07 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-301ecde0-c413-412f-bfa9-301d3baf1182 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:07 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-301ecde0-c413-412f-bfa9-301d3baf1182 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:07 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-301ecde0-c413-412f-bfa9-301d3baf1182 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:07 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-301ecde0-c413-412f-bfa9-301d3baf1182 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:07 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-301ecde0-c413-412f-bfa9-301d3baf1182 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:07 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-301ecde0-c413-412f-bfa9-301d3baf1182 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:35:07 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-301ecde0-c413-412f-bfa9-301d3baf1182 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:35:07 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-301ecde0-c413-412f-bfa9-301d3baf1182 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:35:07 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-301ecde0-c413-412f-bfa9-301d3baf1182 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d09cda86-eca1-4c42-8654-758eb6cd30e0" status: 200 len: 1753 microversion: 2.87 time: 0.184814 Apr 11 15:35:07 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 196/578] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:35:07 2023] GET /compute/v2.1/servers/d09cda86-eca1-4c42-8654-758eb6cd30e0 => generated 1753 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:35:09 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:35:09 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:35:09 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-bb48905c-7592-4fcb-ac56-449ea6c8cb97 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ed3f22c-df4a-47b6-a1a4-35d2fc3b93ec"}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:35:09 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-bb48905c-7592-4fcb-ac56-449ea6c8cb97 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:35:09 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-bb48905c-7592-4fcb-ac56-449ea6c8cb97 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:09 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-bb48905c-7592-4fcb-ac56-449ea6c8cb97 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:09 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-bb48905c-7592-4fcb-ac56-449ea6c8cb97 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:09 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-bb48905c-7592-4fcb-ac56-449ea6c8cb97 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:09 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-bb48905c-7592-4fcb-ac56-449ea6c8cb97 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:09 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-bb48905c-7592-4fcb-ac56-449ea6c8cb97 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:09 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-bb48905c-7592-4fcb-ac56-449ea6c8cb97 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.594350 Apr 11 15:35:09 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 192/579] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Apr 11 15:35:09 2023] POST /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/os-volume_attachments => generated 188 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 15:35:09 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-2420538f-3d01-46d0-b6bb-f4b15d4ce1e6 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:35:09 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-2420538f-3d01-46d0-b6bb-f4b15d4ce1e6 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:35:09 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=3 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:35:09 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=3 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:35:09 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-2420538f-3d01-46d0-b6bb-f4b15d4ce1e6 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:09 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-2420538f-3d01-46d0-b6bb-f4b15d4ce1e6 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:09 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-2420538f-3d01-46d0-b6bb-f4b15d4ce1e6 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:09 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-2420538f-3d01-46d0-b6bb-f4b15d4ce1e6 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:09 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-2420538f-3d01-46d0-b6bb-f4b15d4ce1e6 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:09 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-2420538f-3d01-46d0-b6bb-f4b15d4ce1e6 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:10 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-2420538f-3d01-46d0-b6bb-f4b15d4ce1e6 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/os-volume_attachments/9ed3f22c-df4a-47b6-a1a4-35d2fc3b93ec" status: 202 len: 0 microversion: 2.20 time: 0.291737 Apr 11 15:35:10 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 192/580] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Apr 11 15:35:09 2023] DELETE /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/os-volume_attachments/9ed3f22c-df4a-47b6-a1a4-35d2fc3b93ec => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:35:10 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:35:10 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:35:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:10 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61167) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 11 15:35:10 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/action" status: 202 len: 0 microversion: 2.20 time: 0.111690 Apr 11 15:35:10 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 197/581] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 15:35:10 2023] POST /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:35:10 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-cdeafcc2-e840-43f9-a3b9-7392d54cf107 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:35:10 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-cdeafcc2-e840-43f9-a3b9-7392d54cf107 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:35:10 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cdeafcc2-e840-43f9-a3b9-7392d54cf107 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:10 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cdeafcc2-e840-43f9-a3b9-7392d54cf107 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:10 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cdeafcc2-e840-43f9-a3b9-7392d54cf107 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:10 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cdeafcc2-e840-43f9-a3b9-7392d54cf107 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:10 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cdeafcc2-e840-43f9-a3b9-7392d54cf107 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:10 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cdeafcc2-e840-43f9-a3b9-7392d54cf107 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:10 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-cdeafcc2-e840-43f9-a3b9-7392d54cf107 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:35:10 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-cdeafcc2-e840-43f9-a3b9-7392d54cf107 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:35:10 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-cdeafcc2-e840-43f9-a3b9-7392d54cf107 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:35:10 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-cdeafcc2-e840-43f9-a3b9-7392d54cf107 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59" status: 200 len: 1662 microversion: 2.20 time: 0.170280 Apr 11 15:35:10 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 193/582] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:35:10 2023] GET /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59 => generated 1662 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:35:12 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-8e7cfb3c-cd70-424f-a619-9df113476345 req-a463f2db-a5a9-4df2-bc24-dc1b7bf9cc21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffc25fc1-e59f-42c8-a371-b4b12e17fd59", "tag": "3ae0cd28-c459-47b7-be17-133b69773f9c"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:35:12 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-8e7cfb3c-cd70-424f-a619-9df113476345 req-a463f2db-a5a9-4df2-bc24-dc1b7bf9cc21 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:12 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-8e7cfb3c-cd70-424f-a619-9df113476345 req-a463f2db-a5a9-4df2-bc24-dc1b7bf9cc21 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:12 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-8e7cfb3c-cd70-424f-a619-9df113476345 req-a463f2db-a5a9-4df2-bc24-dc1b7bf9cc21 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:12 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-8e7cfb3c-cd70-424f-a619-9df113476345 req-a463f2db-a5a9-4df2-bc24-dc1b7bf9cc21 service nova] Creating event network-changed:3ae0cd28-c459-47b7-be17-133b69773f9c for instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 on user Apr 11 15:35:12 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-8e7cfb3c-cd70-424f-a619-9df113476345 req-a463f2db-a5a9-4df2-bc24-dc1b7bf9cc21 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028391 Apr 11 15:35:12 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 193/583] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:35:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:35:19 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-4082546e-4ffe-455e-bbaf-855421264ac5 req-b4ab5d79-677d-4478-a53b-8abd617ef06c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc25fc1-e59f-42c8-a371-b4b12e17fd59", "name": "network-vif-plugged", "status": "completed", "tag": "3ae0cd28-c459-47b7-be17-133b69773f9c"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:35:19 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-4082546e-4ffe-455e-bbaf-855421264ac5 req-b4ab5d79-677d-4478-a53b-8abd617ef06c service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:19 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-4082546e-4ffe-455e-bbaf-855421264ac5 req-b4ab5d79-677d-4478-a53b-8abd617ef06c service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:19 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-4082546e-4ffe-455e-bbaf-855421264ac5 req-b4ab5d79-677d-4478-a53b-8abd617ef06c service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:19 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-4082546e-4ffe-455e-bbaf-855421264ac5 req-b4ab5d79-677d-4478-a53b-8abd617ef06c service nova] Creating event network-vif-plugged:3ae0cd28-c459-47b7-be17-133b69773f9c for instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 on user Apr 11 15:35:19 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-4082546e-4ffe-455e-bbaf-855421264ac5 req-b4ab5d79-677d-4478-a53b-8abd617ef06c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032088 Apr 11 15:35:19 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 198/584] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:35:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:35:21 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-ac9280e7-05b2-41f8-9c2e-60b5e0a65651 req-ded65ac9-b634-4373-8e56-fb836f67b22f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc25fc1-e59f-42c8-a371-b4b12e17fd59", "name": "network-vif-plugged", "status": "completed", "tag": "3ae0cd28-c459-47b7-be17-133b69773f9c"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:35:21 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:35:21 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:35:21 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-ac9280e7-05b2-41f8-9c2e-60b5e0a65651 req-ded65ac9-b634-4373-8e56-fb836f67b22f service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:21 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-ac9280e7-05b2-41f8-9c2e-60b5e0a65651 req-ded65ac9-b634-4373-8e56-fb836f67b22f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:21 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-ac9280e7-05b2-41f8-9c2e-60b5e0a65651 req-ded65ac9-b634-4373-8e56-fb836f67b22f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:21 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-ac9280e7-05b2-41f8-9c2e-60b5e0a65651 req-ded65ac9-b634-4373-8e56-fb836f67b22f service nova] Creating event network-vif-plugged:3ae0cd28-c459-47b7-be17-133b69773f9c for instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 on user Apr 11 15:35:21 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-ac9280e7-05b2-41f8-9c2e-60b5e0a65651 req-ded65ac9-b634-4373-8e56-fb836f67b22f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038998 Apr 11 15:35:21 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 194/585] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:35:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:35:22 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-15ad0695-7818-4834-b68d-c4636aabead6 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:35:22 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-15ad0695-7818-4834-b68d-c4636aabead6 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:35:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-15ad0695-7818-4834-b68d-c4636aabead6 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-15ad0695-7818-4834-b68d-c4636aabead6 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-15ad0695-7818-4834-b68d-c4636aabead6 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-15ad0695-7818-4834-b68d-c4636aabead6 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-15ad0695-7818-4834-b68d-c4636aabead6 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-15ad0695-7818-4834-b68d-c4636aabead6 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:22 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-b1238d40-3c5a-4279-a61e-2fae657a8361 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:35:22 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-b1238d40-3c5a-4279-a61e-2fae657a8361 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:35:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b1238d40-3c5a-4279-a61e-2fae657a8361 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b1238d40-3c5a-4279-a61e-2fae657a8361 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b1238d40-3c5a-4279-a61e-2fae657a8361 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b1238d40-3c5a-4279-a61e-2fae657a8361 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b1238d40-3c5a-4279-a61e-2fae657a8361 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b1238d40-3c5a-4279-a61e-2fae657a8361 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:22 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-15ad0695-7818-4834-b68d-c4636aabead6 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402ec212c8a64a559f82c166070a92ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f7abe5e3144c7ab354ffaba1748616', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:35:22 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-15ad0695-7818-4834-b68d-c4636aabead6 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f34c2249-840e-4475-87e6-648d173bc7ed" status: 200 len: 1538 microversion: 2.1 time: 0.200290 Apr 11 15:35:22 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 194/586] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:35:22 2023] GET /compute/v2.1/servers/f34c2249-840e-4475-87e6-648d173bc7ed => generated 1538 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:35:22 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-b1238d40-3c5a-4279-a61e-2fae657a8361 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] HTTP exception thrown: Instance 6a805345-374c-4326-9e8f-39bfc7947a35 could not be found. Apr 11 15:35:22 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-b1238d40-3c5a-4279-a61e-2fae657a8361 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Request method failure captured: Apr 11 15:35:22 user devstack@n-api.service[61167]: request: GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35 HTTP/1.1 Apr 11 15:35:22 user devstack@n-api.service[61167]: Accept: application/json Apr 11 15:35:22 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 15:35:22 user devstack@n-api.service[61167]: Connection: close Apr 11 15:35:22 user devstack@n-api.service[61167]: Content-Length: 0 Apr 11 15:35:22 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 15:35:22 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 15:35:22 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 15:35:22 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 15:35:22 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNXrYvI576bfomvCXZOrRtX3e2WmI0QGGCZ-UwRPLPuWgxsvMU36nQ66FN0clBQeDihHABwOLAnAowbsIYeSiNwDxFudaK_nP7q4dDBOqIbmzwyfS5wL-Xwj8ivjkgXoPykYGSjyYhQcHlwVjZYOpOkrwJAeWupSEmtcb6WkxeGjFduc Apr 11 15:35:22 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 15:35:22 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 15:35:22 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 15:35:22 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 15:35:22 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 15:35:22 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 15:35:22 user devstack@n-api.service[61167]: X-Project-Id: bb7660e8f76b471487136806ee9eec62 Apr 11 15:35:22 user devstack@n-api.service[61167]: X-Project-Name: tempest-ServerActionsTestJSON-1659503440 Apr 11 15:35:22 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 15:35:22 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 15:35:22 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb7660e8f76b471487136806ee9eec62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bb7660e8f76b471487136806ee9eec62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb7660e8f76b471487136806ee9eec62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:35:22 user devstack@n-api.service[61167]: X-Tenant: tempest-ServerActionsTestJSON-1659503440 Apr 11 15:35:22 user devstack@n-api.service[61167]: X-Tenant-Id: bb7660e8f76b471487136806ee9eec62 Apr 11 15:35:22 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-ServerActionsTestJSON-1659503440 Apr 11 15:35:22 user devstack@n-api.service[61167]: X-User: tempest-ServerActionsTestJSON-1659503440-project-member Apr 11 15:35:22 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 15:35:22 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 15:35:22 user devstack@n-api.service[61167]: X-User-Id: 10720df0ac4f4e62a0a5c9883d600add Apr 11 15:35:22 user devstack@n-api.service[61167]: X-User-Name: tempest-ServerActionsTestJSON-1659503440-project-member Apr 11 15:35:22 user devstack@n-api.service[61167]: method: > Apr 11 15:35:22 user devstack@n-api.service[61167]: exception: Instance 6a805345-374c-4326-9e8f-39bfc7947a35 could not be found. Apr 11 15:35:22 user devstack@n-api.service[61167]: action_args: {'id': '6a805345-374c-4326-9e8f-39bfc7947a35'} Apr 11 15:35:22 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a805345-374c-4326-9e8f-39bfc7947a35 could not be found. Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a805345-374c-4326-9e8f-39bfc7947a35 could not be found. Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a805345-374c-4326-9e8f-39bfc7947a35 could not be found. Apr 11 15:35:22 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:35:22 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-b1238d40-3c5a-4279-a61e-2fae657a8361 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Returning 404 to user: Instance 6a805345-374c-4326-9e8f-39bfc7947a35 could not be found. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:35:22 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-b1238d40-3c5a-4279-a61e-2fae657a8361 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35" status: 404 len: 111 microversion: 2.1 time: 0.053528 Apr 11 15:35:22 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 199/587] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:35:22 2023] GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:35:23 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-ba530e00-cb51-43df-99aa-43dc043ab535 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:35:23 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-ba530e00-cb51-43df-99aa-43dc043ab535 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:35:23 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ba530e00-cb51-43df-99aa-43dc043ab535 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:23 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ba530e00-cb51-43df-99aa-43dc043ab535 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:23 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ba530e00-cb51-43df-99aa-43dc043ab535 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:23 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ba530e00-cb51-43df-99aa-43dc043ab535 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:23 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ba530e00-cb51-43df-99aa-43dc043ab535 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:23 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ba530e00-cb51-43df-99aa-43dc043ab535 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:23 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-ba530e00-cb51-43df-99aa-43dc043ab535 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] HTTP exception thrown: Instance 6a805345-374c-4326-9e8f-39bfc7947a35 could not be found. Apr 11 15:35:23 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-ba530e00-cb51-43df-99aa-43dc043ab535 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Request method failure captured: Apr 11 15:35:23 user devstack@n-api.service[61165]: request: GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35/os-volume_attachments HTTP/1.1 Apr 11 15:35:23 user devstack@n-api.service[61165]: Accept: application/json Apr 11 15:35:23 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 15:35:23 user devstack@n-api.service[61165]: Connection: close Apr 11 15:35:23 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 15:35:23 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 15:35:23 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 15:35:23 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 15:35:23 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 15:35:23 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNXrYvI576bfomvCXZOrRtX3e2WmI0QGGCZ-UwRPLPuWgxsvMU36nQ66FN0clBQeDihHABwOLAnAowbsIYeSiNwDxFudaK_nP7q4dDBOqIbmzwyfS5wL-Xwj8ivjkgXoPykYGSjyYhQcHlwVjZYOpOkrwJAeWupSEmtcb6WkxeGjFduc Apr 11 15:35:23 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 15:35:23 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 15:35:23 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 15:35:23 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 15:35:23 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 15:35:23 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 15:35:23 user devstack@n-api.service[61165]: X-Project-Id: bb7660e8f76b471487136806ee9eec62 Apr 11 15:35:23 user devstack@n-api.service[61165]: X-Project-Name: tempest-ServerActionsTestJSON-1659503440 Apr 11 15:35:23 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 15:35:23 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 15:35:23 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb7660e8f76b471487136806ee9eec62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bb7660e8f76b471487136806ee9eec62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb7660e8f76b471487136806ee9eec62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:35:23 user devstack@n-api.service[61165]: X-Tenant: tempest-ServerActionsTestJSON-1659503440 Apr 11 15:35:23 user devstack@n-api.service[61165]: X-Tenant-Id: bb7660e8f76b471487136806ee9eec62 Apr 11 15:35:23 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-ServerActionsTestJSON-1659503440 Apr 11 15:35:23 user devstack@n-api.service[61165]: X-User: tempest-ServerActionsTestJSON-1659503440-project-member Apr 11 15:35:23 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 15:35:23 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 15:35:23 user devstack@n-api.service[61165]: X-User-Id: 10720df0ac4f4e62a0a5c9883d600add Apr 11 15:35:23 user devstack@n-api.service[61165]: X-User-Name: tempest-ServerActionsTestJSON-1659503440-project-member Apr 11 15:35:23 user devstack@n-api.service[61165]: method: > Apr 11 15:35:23 user devstack@n-api.service[61165]: exception: Instance 6a805345-374c-4326-9e8f-39bfc7947a35 could not be found. Apr 11 15:35:23 user devstack@n-api.service[61165]: action_args: {'server_id': '6a805345-374c-4326-9e8f-39bfc7947a35'} Apr 11 15:35:23 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a805345-374c-4326-9e8f-39bfc7947a35 could not be found. Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a805345-374c-4326-9e8f-39bfc7947a35 could not be found. Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a805345-374c-4326-9e8f-39bfc7947a35 could not be found. Apr 11 15:35:23 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:35:23 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-ba530e00-cb51-43df-99aa-43dc043ab535 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Returning 404 to user: Instance 6a805345-374c-4326-9e8f-39bfc7947a35 could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:35:23 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-ba530e00-cb51-43df-99aa-43dc043ab535 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036537 Apr 11 15:35:23 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 195/588] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:35:22 2023] GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:35:23 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-8c079c16-ba72-4054-9a65-88f6644948b0 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:35:23 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-8c079c16-ba72-4054-9a65-88f6644948b0 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:35:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8c079c16-ba72-4054-9a65-88f6644948b0 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8c079c16-ba72-4054-9a65-88f6644948b0 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8c079c16-ba72-4054-9a65-88f6644948b0 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8c079c16-ba72-4054-9a65-88f6644948b0 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8c079c16-ba72-4054-9a65-88f6644948b0 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8c079c16-ba72-4054-9a65-88f6644948b0 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:23 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-8c079c16-ba72-4054-9a65-88f6644948b0 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] HTTP exception thrown: Instance 6a805345-374c-4326-9e8f-39bfc7947a35 could not be found. Apr 11 15:35:23 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-8c079c16-ba72-4054-9a65-88f6644948b0 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Request method failure captured: Apr 11 15:35:23 user devstack@n-api.service[61166]: request: GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35 HTTP/1.1 Apr 11 15:35:23 user devstack@n-api.service[61166]: Accept: application/json Apr 11 15:35:23 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 15:35:23 user devstack@n-api.service[61166]: Connection: close Apr 11 15:35:23 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 15:35:23 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 15:35:23 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 15:35:23 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 15:35:23 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 15:35:23 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNXrYvI576bfomvCXZOrRtX3e2WmI0QGGCZ-UwRPLPuWgxsvMU36nQ66FN0clBQeDihHABwOLAnAowbsIYeSiNwDxFudaK_nP7q4dDBOqIbmzwyfS5wL-Xwj8ivjkgXoPykYGSjyYhQcHlwVjZYOpOkrwJAeWupSEmtcb6WkxeGjFduc Apr 11 15:35:23 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 15:35:23 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 15:35:23 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 15:35:23 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 15:35:23 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 15:35:23 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 15:35:23 user devstack@n-api.service[61166]: X-Project-Id: bb7660e8f76b471487136806ee9eec62 Apr 11 15:35:23 user devstack@n-api.service[61166]: X-Project-Name: tempest-ServerActionsTestJSON-1659503440 Apr 11 15:35:23 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 15:35:23 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 15:35:23 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb7660e8f76b471487136806ee9eec62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bb7660e8f76b471487136806ee9eec62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb7660e8f76b471487136806ee9eec62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:35:23 user devstack@n-api.service[61166]: X-Tenant: tempest-ServerActionsTestJSON-1659503440 Apr 11 15:35:23 user devstack@n-api.service[61166]: X-Tenant-Id: bb7660e8f76b471487136806ee9eec62 Apr 11 15:35:23 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-ServerActionsTestJSON-1659503440 Apr 11 15:35:23 user devstack@n-api.service[61166]: X-User: tempest-ServerActionsTestJSON-1659503440-project-member Apr 11 15:35:23 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 15:35:23 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 15:35:23 user devstack@n-api.service[61166]: X-User-Id: 10720df0ac4f4e62a0a5c9883d600add Apr 11 15:35:23 user devstack@n-api.service[61166]: X-User-Name: tempest-ServerActionsTestJSON-1659503440-project-member Apr 11 15:35:23 user devstack@n-api.service[61166]: method: > Apr 11 15:35:23 user devstack@n-api.service[61166]: exception: Instance 6a805345-374c-4326-9e8f-39bfc7947a35 could not be found. Apr 11 15:35:23 user devstack@n-api.service[61166]: action_args: {'id': '6a805345-374c-4326-9e8f-39bfc7947a35'} Apr 11 15:35:23 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a805345-374c-4326-9e8f-39bfc7947a35 could not be found. Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a805345-374c-4326-9e8f-39bfc7947a35 could not be found. Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a805345-374c-4326-9e8f-39bfc7947a35 could not be found. Apr 11 15:35:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:35:23 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-8c079c16-ba72-4054-9a65-88f6644948b0 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Returning 404 to user: Instance 6a805345-374c-4326-9e8f-39bfc7947a35 could not be found. {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:35:23 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-8c079c16-ba72-4054-9a65-88f6644948b0 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35" status: 404 len: 111 microversion: 2.1 time: 0.037705 Apr 11 15:35:23 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 195/589] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:35:23 2023] GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 15:35:23 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1108207278", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "networks": [{"uuid": "1bd215e8-0459-4dd2-893b-096b6e31ac08"}], "security_groups": [{"name": "tempest-securitygroup--1617652564"}], "key_name": "tempest-keypair-1137963694", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:35:23 user devstack@n-api.service[61167]: DEBUG nova.network.neutron [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] validate_networks() for [('1bd215e8-0459-4dd2-893b-096b6e31ac08', None, None, None, None, None)] {{(pid=61167) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:35:23 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Flavor limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:35:23 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Image limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:35:23 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Flavor pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:35:23 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Image pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:35:23 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:35:23 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:23 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:23 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:23 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:23 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:23 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:23 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Getting quotas for project bb7660e8f76b471487136806ee9eec62. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:35:23 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Getting quotas for user 10720df0ac4f4e62a0a5c9883d600add and project bb7660e8f76b471487136806ee9eec62. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:35:23 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Going to run 1 instances... {{(pid=61167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:35:23 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52fe638c-5ada-47d5-b376-233bfa808a37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:35:23 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.611780 Apr 11 15:35:23 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 200/590] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 15:35:23 2023] POST /compute/v2.1/servers => generated 404 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 15:35:23 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-3dd749bb-3689-44ea-a178-0889fad42c8d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:35:23 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-3dd749bb-3689-44ea-a178-0889fad42c8d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:35:23 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-3dd749bb-3689-44ea-a178-0889fad42c8d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:35:24 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-3dd749bb-3689-44ea-a178-0889fad42c8d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e" status: 200 len: 1233 microversion: 2.1 time: 0.086038 Apr 11 15:35:24 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 196/591] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:35:23 2023] GET /compute/v2.1/servers/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e => generated 1233 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:35:27 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-ecdb717f-d182-4a15-9539-788dc8499314 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:35:27 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-ecdb717f-d182-4a15-9539-788dc8499314 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:35:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ecdb717f-d182-4a15-9539-788dc8499314 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ecdb717f-d182-4a15-9539-788dc8499314 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ecdb717f-d182-4a15-9539-788dc8499314 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ecdb717f-d182-4a15-9539-788dc8499314 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ecdb717f-d182-4a15-9539-788dc8499314 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ecdb717f-d182-4a15-9539-788dc8499314 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:27 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-ecdb717f-d182-4a15-9539-788dc8499314 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] HTTP exception thrown: Instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 could not be found. Apr 11 15:35:27 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-ecdb717f-d182-4a15-9539-788dc8499314 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Request method failure captured: Apr 11 15:35:27 user devstack@n-api.service[61166]: request: GET /compute/v2.1/servers/fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 HTTP/1.1 Apr 11 15:35:27 user devstack@n-api.service[61166]: Accept: application/json Apr 11 15:35:27 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 15:35:27 user devstack@n-api.service[61166]: Connection: close Apr 11 15:35:27 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 15:35:27 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 15:35:27 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 15:35:27 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 15:35:27 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 15:35:27 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNX2G9hoH_lvZyjCjFOK-Uyxv3X4-bTCqcSWv4AkEiMWPDMvNkCh5nQ-uu1SS30ADhzNPCp7vKze48LYwQsK8YVg7zXHaiXJmVR6t6VqKkLJdMAcvY5prKEFco7ckKO82XQoHQVe6qVED5BQjfKLm0uacMUlqnZPlfpA1klk6uQm7_-E Apr 11 15:35:27 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 15:35:27 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 15:35:27 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 15:35:27 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 15:35:27 user devstack@n-api.service[61166]: X-Openstack-Nova-Api-Version: 2.32 Apr 11 15:35:27 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 15:35:27 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 15:35:27 user devstack@n-api.service[61166]: X-Project-Id: 7df6e56783b84282be0ca425358015dd Apr 11 15:35:27 user devstack@n-api.service[61166]: X-Project-Name: tempest-TaggedBootDevicesTest-341576311 Apr 11 15:35:27 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 15:35:27 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 15:35:27 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7df6e56783b84282be0ca425358015dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7df6e56783b84282be0ca425358015dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7df6e56783b84282be0ca425358015dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:35:27 user devstack@n-api.service[61166]: X-Tenant: tempest-TaggedBootDevicesTest-341576311 Apr 11 15:35:27 user devstack@n-api.service[61166]: X-Tenant-Id: 7df6e56783b84282be0ca425358015dd Apr 11 15:35:27 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-TaggedBootDevicesTest-341576311 Apr 11 15:35:27 user devstack@n-api.service[61166]: X-User: tempest-TaggedBootDevicesTest-341576311-project-member Apr 11 15:35:27 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 15:35:27 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 15:35:27 user devstack@n-api.service[61166]: X-User-Id: 645eeb4fbb2a46d09fd18eaf7de500d0 Apr 11 15:35:27 user devstack@n-api.service[61166]: X-User-Name: tempest-TaggedBootDevicesTest-341576311-project-member Apr 11 15:35:27 user devstack@n-api.service[61166]: method: > Apr 11 15:35:27 user devstack@n-api.service[61166]: exception: Instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 could not be found. Apr 11 15:35:27 user devstack@n-api.service[61166]: action_args: {'id': 'fa6dc9c1-6786-4c17-a23e-f71c21ac08a7'} Apr 11 15:35:27 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 could not be found. Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 could not be found. Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 could not be found. Apr 11 15:35:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:35:27 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-ecdb717f-d182-4a15-9539-788dc8499314 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Returning 404 to user: Instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 could not be found. {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:35:27 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-ecdb717f-d182-4a15-9539-788dc8499314 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" status: 404 len: 111 microversion: 2.32 time: 0.031718 Apr 11 15:35:27 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 196/592] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:35:27 2023] GET /compute/v2.1/servers/fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 15:35:27 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-060d9126-d832-4f6d-bdcb-476b72414f34 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Calling method '.version_select at 0x7f4c2ecdacb0>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:35:27 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-060d9126-d832-4f6d-bdcb-476b72414f34 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1319177828" status: 204 len: 0 microversion: 2.32 time: 0.046227 Apr 11 15:35:27 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 201/593] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Apr 11 15:35:27 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1319177828 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 15:35:27 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-0643ee65-d2c3-4992-ad33-0cc75273ae8d req-fbb5f463-49fd-4527-ab1a-0be80c003a82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcbfcbfd-7e96-4271-94ee-60ef937e3b7e", "tag": "32c006ee-14e2-47d8-b999-bafc729aa67a"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:35:27 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-0643ee65-d2c3-4992-ad33-0cc75273ae8d req-fbb5f463-49fd-4527-ab1a-0be80c003a82 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:27 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-0643ee65-d2c3-4992-ad33-0cc75273ae8d req-fbb5f463-49fd-4527-ab1a-0be80c003a82 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:27 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-0643ee65-d2c3-4992-ad33-0cc75273ae8d req-fbb5f463-49fd-4527-ab1a-0be80c003a82 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:27 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-0643ee65-d2c3-4992-ad33-0cc75273ae8d req-fbb5f463-49fd-4527-ab1a-0be80c003a82 service nova] Creating event network-changed:32c006ee-14e2-47d8-b999-bafc729aa67a for instance dcbfcbfd-7e96-4271-94ee-60ef937e3b7e on user Apr 11 15:35:27 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-0643ee65-d2c3-4992-ad33-0cc75273ae8d req-fbb5f463-49fd-4527-ab1a-0be80c003a82 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046288 Apr 11 15:35:27 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 197/594] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:35:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:35:29 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-2b3d6c3e-9ce4-4351-b864-b7b456a5a802 req-43484d95-951b-40d8-8793-f7b6ae395c75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcbfcbfd-7e96-4271-94ee-60ef937e3b7e", "name": "network-vif-plugged", "status": "completed", "tag": "32c006ee-14e2-47d8-b999-bafc729aa67a"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:35:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-2b3d6c3e-9ce4-4351-b864-b7b456a5a802 req-43484d95-951b-40d8-8793-f7b6ae395c75 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-2b3d6c3e-9ce4-4351-b864-b7b456a5a802 req-43484d95-951b-40d8-8793-f7b6ae395c75 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-2b3d6c3e-9ce4-4351-b864-b7b456a5a802 req-43484d95-951b-40d8-8793-f7b6ae395c75 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:29 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-2b3d6c3e-9ce4-4351-b864-b7b456a5a802 req-43484d95-951b-40d8-8793-f7b6ae395c75 service nova] Creating event network-vif-plugged:32c006ee-14e2-47d8-b999-bafc729aa67a for instance dcbfcbfd-7e96-4271-94ee-60ef937e3b7e on user Apr 11 15:35:29 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-2b3d6c3e-9ce4-4351-b864-b7b456a5a802 req-43484d95-951b-40d8-8793-f7b6ae395c75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047335 Apr 11 15:35:29 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 197/595] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:35:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:35:31 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-b9abc9a8-9f38-43ef-a3be-0d246f8203e2 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:35:31 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-b9abc9a8-9f38-43ef-a3be-0d246f8203e2 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:35:31 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b9abc9a8-9f38-43ef-a3be-0d246f8203e2 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:31 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b9abc9a8-9f38-43ef-a3be-0d246f8203e2 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:31 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b9abc9a8-9f38-43ef-a3be-0d246f8203e2 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:31 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b9abc9a8-9f38-43ef-a3be-0d246f8203e2 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:31 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b9abc9a8-9f38-43ef-a3be-0d246f8203e2 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:31 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b9abc9a8-9f38-43ef-a3be-0d246f8203e2 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:31 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-b9abc9a8-9f38-43ef-a3be-0d246f8203e2 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] HTTP exception thrown: Instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 could not be found. Apr 11 15:35:31 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-b9abc9a8-9f38-43ef-a3be-0d246f8203e2 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Request method failure captured: Apr 11 15:35:31 user devstack@n-api.service[61167]: request: DELETE /compute/v2.1/servers/fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 HTTP/1.1 Apr 11 15:35:31 user devstack@n-api.service[61167]: Accept: application/json Apr 11 15:35:31 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 15:35:31 user devstack@n-api.service[61167]: Connection: close Apr 11 15:35:31 user devstack@n-api.service[61167]: Content-Length: 0 Apr 11 15:35:31 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 15:35:31 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 15:35:31 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 15:35:31 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 15:35:31 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNX2G9hoH_lvZyjCjFOK-Uyxv3X4-bTCqcSWv4AkEiMWPDMvNkCh5nQ-uu1SS30ADhzNPCp7vKze48LYwQsK8YVg7zXHaiXJmVR6t6VqKkLJdMAcvY5prKEFco7ckKO82XQoHQVe6qVED5BQjfKLm0uacMUlqnZPlfpA1klk6uQm7_-E Apr 11 15:35:31 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 15:35:31 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 15:35:31 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 15:35:31 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 15:35:31 user devstack@n-api.service[61167]: X-Openstack-Nova-Api-Version: 2.32 Apr 11 15:35:31 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 15:35:31 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 15:35:31 user devstack@n-api.service[61167]: X-Project-Id: 7df6e56783b84282be0ca425358015dd Apr 11 15:35:31 user devstack@n-api.service[61167]: X-Project-Name: tempest-TaggedBootDevicesTest-341576311 Apr 11 15:35:31 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 15:35:31 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 15:35:31 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7df6e56783b84282be0ca425358015dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7df6e56783b84282be0ca425358015dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7df6e56783b84282be0ca425358015dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:35:31 user devstack@n-api.service[61167]: X-Tenant: tempest-TaggedBootDevicesTest-341576311 Apr 11 15:35:31 user devstack@n-api.service[61167]: X-Tenant-Id: 7df6e56783b84282be0ca425358015dd Apr 11 15:35:31 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-TaggedBootDevicesTest-341576311 Apr 11 15:35:31 user devstack@n-api.service[61167]: X-User: tempest-TaggedBootDevicesTest-341576311-project-member Apr 11 15:35:31 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 15:35:31 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 15:35:31 user devstack@n-api.service[61167]: X-User-Id: 645eeb4fbb2a46d09fd18eaf7de500d0 Apr 11 15:35:31 user devstack@n-api.service[61167]: X-User-Name: tempest-TaggedBootDevicesTest-341576311-project-member Apr 11 15:35:31 user devstack@n-api.service[61167]: method: > Apr 11 15:35:31 user devstack@n-api.service[61167]: exception: Instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 could not be found. Apr 11 15:35:31 user devstack@n-api.service[61167]: action_args: {'id': 'fa6dc9c1-6786-4c17-a23e-f71c21ac08a7'} Apr 11 15:35:31 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 could not be found. Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 could not be found. Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 could not be found. Apr 11 15:35:31 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:35:31 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-b9abc9a8-9f38-43ef-a3be-0d246f8203e2 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Returning 404 to user: Instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 could not be found. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:35:31 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-b9abc9a8-9f38-43ef-a3be-0d246f8203e2 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" status: 404 len: 111 microversion: 2.32 time: 0.028275 Apr 11 15:35:31 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 202/596] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 15:35:31 2023] DELETE /compute/v2.1/servers/fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 15:35:31 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-24fcc049-6fbb-4279-a5c7-f88db7d9d6f8 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:35:31 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-24fcc049-6fbb-4279-a5c7-f88db7d9d6f8 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:35:31 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-24fcc049-6fbb-4279-a5c7-f88db7d9d6f8 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:31 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-24fcc049-6fbb-4279-a5c7-f88db7d9d6f8 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:31 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-24fcc049-6fbb-4279-a5c7-f88db7d9d6f8 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:31 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-24fcc049-6fbb-4279-a5c7-f88db7d9d6f8 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:31 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-24fcc049-6fbb-4279-a5c7-f88db7d9d6f8 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:31 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-24fcc049-6fbb-4279-a5c7-f88db7d9d6f8 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:31 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-24fcc049-6fbb-4279-a5c7-f88db7d9d6f8 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] HTTP exception thrown: Instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 could not be found. Apr 11 15:35:31 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-24fcc049-6fbb-4279-a5c7-f88db7d9d6f8 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Request method failure captured: Apr 11 15:35:31 user devstack@n-api.service[61165]: request: GET /compute/v2.1/servers/fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 HTTP/1.1 Apr 11 15:35:31 user devstack@n-api.service[61165]: Accept: application/json Apr 11 15:35:31 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 15:35:31 user devstack@n-api.service[61165]: Connection: close Apr 11 15:35:31 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 15:35:31 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 15:35:31 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 15:35:31 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 15:35:31 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 15:35:31 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNX2G9hoH_lvZyjCjFOK-Uyxv3X4-bTCqcSWv4AkEiMWPDMvNkCh5nQ-uu1SS30ADhzNPCp7vKze48LYwQsK8YVg7zXHaiXJmVR6t6VqKkLJdMAcvY5prKEFco7ckKO82XQoHQVe6qVED5BQjfKLm0uacMUlqnZPlfpA1klk6uQm7_-E Apr 11 15:35:31 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 15:35:31 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 15:35:31 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 15:35:31 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 15:35:31 user devstack@n-api.service[61165]: X-Openstack-Nova-Api-Version: 2.32 Apr 11 15:35:31 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 15:35:31 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 15:35:31 user devstack@n-api.service[61165]: X-Project-Id: 7df6e56783b84282be0ca425358015dd Apr 11 15:35:31 user devstack@n-api.service[61165]: X-Project-Name: tempest-TaggedBootDevicesTest-341576311 Apr 11 15:35:31 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 15:35:31 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 15:35:31 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7df6e56783b84282be0ca425358015dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7df6e56783b84282be0ca425358015dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7df6e56783b84282be0ca425358015dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:35:31 user devstack@n-api.service[61165]: X-Tenant: tempest-TaggedBootDevicesTest-341576311 Apr 11 15:35:31 user devstack@n-api.service[61165]: X-Tenant-Id: 7df6e56783b84282be0ca425358015dd Apr 11 15:35:31 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-TaggedBootDevicesTest-341576311 Apr 11 15:35:31 user devstack@n-api.service[61165]: X-User: tempest-TaggedBootDevicesTest-341576311-project-member Apr 11 15:35:31 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 15:35:31 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 15:35:31 user devstack@n-api.service[61165]: X-User-Id: 645eeb4fbb2a46d09fd18eaf7de500d0 Apr 11 15:35:31 user devstack@n-api.service[61165]: X-User-Name: tempest-TaggedBootDevicesTest-341576311-project-member Apr 11 15:35:31 user devstack@n-api.service[61165]: method: > Apr 11 15:35:31 user devstack@n-api.service[61165]: exception: Instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 could not be found. Apr 11 15:35:31 user devstack@n-api.service[61165]: action_args: {'id': 'fa6dc9c1-6786-4c17-a23e-f71c21ac08a7'} Apr 11 15:35:31 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 could not be found. Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 could not be found. Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 could not be found. Apr 11 15:35:31 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:35:31 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-24fcc049-6fbb-4279-a5c7-f88db7d9d6f8 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Returning 404 to user: Instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:35:31 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-24fcc049-6fbb-4279-a5c7-f88db7d9d6f8 tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" status: 404 len: 111 microversion: 2.32 time: 0.031360 Apr 11 15:35:31 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 198/597] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:35:31 2023] GET /compute/v2.1/servers/fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 15:35:31 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-2ccbabf5-1dfe-4610-b193-698e0f231b34 req-c12bd258-4074-4092-8669-ae0130a9d726 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcbfcbfd-7e96-4271-94ee-60ef937e3b7e", "name": "network-vif-plugged", "status": "completed", "tag": "32c006ee-14e2-47d8-b999-bafc729aa67a"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:35:31 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-2ccbabf5-1dfe-4610-b193-698e0f231b34 req-c12bd258-4074-4092-8669-ae0130a9d726 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:31 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-2ccbabf5-1dfe-4610-b193-698e0f231b34 req-c12bd258-4074-4092-8669-ae0130a9d726 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:31 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-2ccbabf5-1dfe-4610-b193-698e0f231b34 req-c12bd258-4074-4092-8669-ae0130a9d726 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:31 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-2ccbabf5-1dfe-4610-b193-698e0f231b34 req-c12bd258-4074-4092-8669-ae0130a9d726 service nova] Creating event network-vif-plugged:32c006ee-14e2-47d8-b999-bafc729aa67a for instance dcbfcbfd-7e96-4271-94ee-60ef937e3b7e on user Apr 11 15:35:31 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-2ccbabf5-1dfe-4610-b193-698e0f231b34 req-c12bd258-4074-4092-8669-ae0130a9d726 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031316 Apr 11 15:35:31 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 198/598] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:35:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:35:38 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-15284469-c917-427b-9177-4a33ea899dab tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Action: 'create', calling method: .version_select at 0x7f4c2ed6f400>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1861021757", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCX38V29uKqq32pbrXcHfjwmsz6kzESDeVl6gqbOhAcULXo21SBTbxQJXUQHaV8PJeMjZRs4D5UehvHzvnc4jeUpiLPu2JFq1xh2/XZqKhiBdFrsxTD5c6W9I6S8vZoQ6A=="}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:35:38 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:35:38 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:35:38 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:35:38 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-15284469-c917-427b-9177-4a33ea899dab tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Getting quotas for project c23461a3d7ca49f6a77d3fde6f1009d3. Resources: {'key_pairs'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:35:38 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-15284469-c917-427b-9177-4a33ea899dab tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Getting quotas for user 044f17aee3324b3a97bebe935548b3b4 and project c23461a3d7ca49f6a77d3fde6f1009d3. Resources: {'key_pairs'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:35:38 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-15284469-c917-427b-9177-4a33ea899dab tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.055000 Apr 11 15:35:38 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 203/599] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 15:35:38 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:35:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1775975364", "imageRef": "eef769ca-4518-48cc-8f9b-15f43146d184", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1861021757", "networks": [{"uuid": "b1189892-ba9d-4316-9962-c737b27f14bb"}]}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:35:39 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:35:39 user devstack@n-api.service[61165]: DEBUG nova.network.neutron [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] validate_networks() for [('b1189892-ba9d-4316-9962-c737b27f14bb', None, None, None, None, None)] {{(pid=61165) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:35:40 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Flavor limits 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:35:40 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Image limits 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:35:40 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Flavor pref 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:35:40 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Image pref 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:35:40 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:35:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:40 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Getting quotas for project c23461a3d7ca49f6a77d3fde6f1009d3. Resources: {'instances', 'cores', 'ram'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:35:40 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Getting quotas for user 044f17aee3324b3a97bebe935548b3b4 and project c23461a3d7ca49f6a77d3fde6f1009d3. Resources: {'instances', 'cores', 'ram'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:35:40 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Going to run 1 instances... {{(pid=61165) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:35:40 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='eef769ca-4518-48cc-8f9b-15f43146d184',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61165) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:35:40 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.203845 Apr 11 15:35:40 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 199/600] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 15:35:39 2023] POST /compute/v2.1/servers => generated 378 bytes in 1205 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 15:35:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-da9b51cf-eec7-4271-8308-7e2bac7420fd tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:35:40 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-da9b51cf-eec7-4271-8308-7e2bac7420fd tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:35:40 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=15 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:35:40 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-da9b51cf-eec7-4271-8308-7e2bac7420fd tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044f17aee3324b3a97bebe935548b3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23461a3d7ca49f6a77d3fde6f1009d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:35:40 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-da9b51cf-eec7-4271-8308-7e2bac7420fd tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8" status: 200 len: 1253 microversion: 2.1 time: 0.090211 Apr 11 15:35:40 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 199/601] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:35:40 2023] GET /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8 => generated 1253 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:35:43 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:35:43 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-a9e560d6-15ca-4cd0-9db0-d7de1f2ffa4d req-907e8c64-2844-4b95-9a79-b85dea12a196 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e3d0956-d528-4097-a200-d9b2b6ce7aa8", "tag": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:35:43 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-a9e560d6-15ca-4cd0-9db0-d7de1f2ffa4d req-907e8c64-2844-4b95-9a79-b85dea12a196 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:43 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-a9e560d6-15ca-4cd0-9db0-d7de1f2ffa4d req-907e8c64-2844-4b95-9a79-b85dea12a196 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:43 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-a9e560d6-15ca-4cd0-9db0-d7de1f2ffa4d req-907e8c64-2844-4b95-9a79-b85dea12a196 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:43 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-a9e560d6-15ca-4cd0-9db0-d7de1f2ffa4d req-907e8c64-2844-4b95-9a79-b85dea12a196 service nova] Creating event network-changed:19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 for instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 on user Apr 11 15:35:43 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-a9e560d6-15ca-4cd0-9db0-d7de1f2ffa4d req-907e8c64-2844-4b95-9a79-b85dea12a196 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035524 Apr 11 15:35:43 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 204/602] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:35:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:35:45 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-79058470-7cac-4792-971e-7a4ff1e91497 req-db99c15f-19b2-434c-940d-828e795e68e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e3d0956-d528-4097-a200-d9b2b6ce7aa8", "name": "network-vif-plugged", "status": "completed", "tag": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:35:45 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-79058470-7cac-4792-971e-7a4ff1e91497 req-db99c15f-19b2-434c-940d-828e795e68e6 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:45 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-79058470-7cac-4792-971e-7a4ff1e91497 req-db99c15f-19b2-434c-940d-828e795e68e6 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:45 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-79058470-7cac-4792-971e-7a4ff1e91497 req-db99c15f-19b2-434c-940d-828e795e68e6 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:45 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-79058470-7cac-4792-971e-7a4ff1e91497 req-db99c15f-19b2-434c-940d-828e795e68e6 service nova] Creating event network-vif-plugged:19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 for instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 on user Apr 11 15:35:45 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-79058470-7cac-4792-971e-7a4ff1e91497 req-db99c15f-19b2-434c-940d-828e795e68e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032223 Apr 11 15:35:45 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 200/603] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:35:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:35:47 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-90098b84-39cc-4bfc-b79e-89f2681e28d4 req-9a3f7de8-acc2-4d48-93bf-34f75b81816e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e3d0956-d528-4097-a200-d9b2b6ce7aa8", "name": "network-vif-plugged", "status": "completed", "tag": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:35:47 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:35:47 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-90098b84-39cc-4bfc-b79e-89f2681e28d4 req-9a3f7de8-acc2-4d48-93bf-34f75b81816e service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:47 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-90098b84-39cc-4bfc-b79e-89f2681e28d4 req-9a3f7de8-acc2-4d48-93bf-34f75b81816e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:47 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-90098b84-39cc-4bfc-b79e-89f2681e28d4 req-9a3f7de8-acc2-4d48-93bf-34f75b81816e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:47 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-90098b84-39cc-4bfc-b79e-89f2681e28d4 req-9a3f7de8-acc2-4d48-93bf-34f75b81816e service nova] Creating event network-vif-plugged:19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 for instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 on user Apr 11 15:35:47 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-90098b84-39cc-4bfc-b79e-89f2681e28d4 req-9a3f7de8-acc2-4d48-93bf-34f75b81816e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032231 Apr 11 15:35:47 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 200/604] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:35:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:35:51 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=4 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:35:51 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1967250041", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:35:51 user devstack@n-api.service[61167]: DEBUG nova.network.neutron [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] validate_networks() for [('7ba20249-9c62-46d7-810c-8144c1a1f17e', None, None, None, None, None)] {{(pid=61167) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:35:51 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Flavor limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:35:51 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Image limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:35:51 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Flavor pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:35:51 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Image pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:35:51 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:35:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:51 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Getting quotas for project d700a53aa25849e0afd562b05881d09a. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:35:51 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Getting quotas for user 5c8492f96e5d4f54aaae3679c82b6759 and project d700a53aa25849e0afd562b05881d09a. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:35:51 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Going to run 1 instances... {{(pid=61167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:35:51 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52fe638c-5ada-47d5-b376-233bfa808a37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:35:51 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.660761 Apr 11 15:35:51 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 205/605] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 15:35:51 2023] POST /compute/v2.1/servers => generated 381 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 15:35:51 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:35:51 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:35:51 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-1c2a1fbb-faaa-4f16-bc69-513096cc1a57 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:35:51 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-1c2a1fbb-faaa-4f16-bc69-513096cc1a57 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:35:51 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:35:51 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-1c2a1fbb-faaa-4f16-bc69-513096cc1a57 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8492f96e5d4f54aaae3679c82b6759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd700a53aa25849e0afd562b05881d09a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:35:51 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-1c2a1fbb-faaa-4f16-bc69-513096cc1a57 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f6ae64a-c760-4ba3-8a50-d380835d9913" status: 200 len: 1216 microversion: 2.1 time: 0.078027 Apr 11 15:35:51 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 201/606] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:35:51 2023] GET /compute/v2.1/servers/6f6ae64a-c760-4ba3-8a50-d380835d9913 => generated 1216 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:35:52 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1607555869", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:35:52 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:35:52 user devstack@n-api.service[61166]: DEBUG nova.network.neutron [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] validate_networks() for [('7ba20249-9c62-46d7-810c-8144c1a1f17e', None, None, None, None, None)] {{(pid=61166) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:35:52 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Flavor limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:35:52 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Image limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:35:52 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Flavor pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:35:52 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Image pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:35:52 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:35:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:52 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Getting quotas for project d700a53aa25849e0afd562b05881d09a. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:35:52 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Getting quotas for user 5c8492f96e5d4f54aaae3679c82b6759 and project d700a53aa25849e0afd562b05881d09a. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:35:52 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Going to run 1 instances... {{(pid=61166) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:35:52 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52fe638c-5ada-47d5-b376-233bfa808a37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:35:52 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.615271 Apr 11 15:35:52 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 201/607] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 15:35:52 2023] POST /compute/v2.1/servers => generated 381 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 15:35:52 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-ae33b441-7bd2-4981-85ed-941227a5220e tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:35:52 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-ae33b441-7bd2-4981-85ed-941227a5220e tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:35:52 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-ae33b441-7bd2-4981-85ed-941227a5220e tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8492f96e5d4f54aaae3679c82b6759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd700a53aa25849e0afd562b05881d09a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:35:52 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-ae33b441-7bd2-4981-85ed-941227a5220e tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/058df5ba-07ab-4bdd-9a47-907e7b0e0e59" status: 200 len: 1216 microversion: 2.1 time: 0.067705 Apr 11 15:35:52 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 206/608] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:35:52 2023] GET /compute/v2.1/servers/058df5ba-07ab-4bdd-9a47-907e7b0e0e59 => generated 1216 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:35:54 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-5dbd9608-59bf-48ba-8b13-1e2d8f5775ff req-3af06491-b95c-48eb-888c-8fa79bdc1780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f6ae64a-c760-4ba3-8a50-d380835d9913", "tag": "2b891eeb-973f-492a-9059-55961bb956bf"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:35:54 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-5dbd9608-59bf-48ba-8b13-1e2d8f5775ff req-3af06491-b95c-48eb-888c-8fa79bdc1780 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:54 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-5dbd9608-59bf-48ba-8b13-1e2d8f5775ff req-3af06491-b95c-48eb-888c-8fa79bdc1780 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:54 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-5dbd9608-59bf-48ba-8b13-1e2d8f5775ff req-3af06491-b95c-48eb-888c-8fa79bdc1780 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:54 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=13 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:35:54 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-5dbd9608-59bf-48ba-8b13-1e2d8f5775ff req-3af06491-b95c-48eb-888c-8fa79bdc1780 service nova] Creating event network-changed:2b891eeb-973f-492a-9059-55961bb956bf for instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 on user Apr 11 15:35:54 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-5dbd9608-59bf-48ba-8b13-1e2d8f5775ff req-3af06491-b95c-48eb-888c-8fa79bdc1780 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046391 Apr 11 15:35:54 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 202/609] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:35:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:35:55 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-fe0c03a6-6962-434c-b57a-a134e8c61fad req-3603efc3-894b-4554-8c39-2ea488f68ffc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "058df5ba-07ab-4bdd-9a47-907e7b0e0e59", "tag": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:35:55 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-fe0c03a6-6962-434c-b57a-a134e8c61fad req-3603efc3-894b-4554-8c39-2ea488f68ffc service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:55 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-fe0c03a6-6962-434c-b57a-a134e8c61fad req-3603efc3-894b-4554-8c39-2ea488f68ffc service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:55 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-fe0c03a6-6962-434c-b57a-a134e8c61fad req-3603efc3-894b-4554-8c39-2ea488f68ffc service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:55 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-fe0c03a6-6962-434c-b57a-a134e8c61fad req-3603efc3-894b-4554-8c39-2ea488f68ffc service nova] Creating event network-changed:cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 for instance 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 on user Apr 11 15:35:55 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-fe0c03a6-6962-434c-b57a-a134e8c61fad req-3603efc3-894b-4554-8c39-2ea488f68ffc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033993 Apr 11 15:35:55 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 202/610] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:35:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:35:56 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-3a40b5f0-4204-4ec9-8f8a-1e831df5b9c7 req-2fff256a-0121-47f9-81c1-bb3016993dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f6ae64a-c760-4ba3-8a50-d380835d9913", "name": "network-vif-plugged", "status": "completed", "tag": "2b891eeb-973f-492a-9059-55961bb956bf"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:35:56 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-3a40b5f0-4204-4ec9-8f8a-1e831df5b9c7 req-2fff256a-0121-47f9-81c1-bb3016993dc2 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:56 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-3a40b5f0-4204-4ec9-8f8a-1e831df5b9c7 req-2fff256a-0121-47f9-81c1-bb3016993dc2 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:56 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-3a40b5f0-4204-4ec9-8f8a-1e831df5b9c7 req-2fff256a-0121-47f9-81c1-bb3016993dc2 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:56 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-3a40b5f0-4204-4ec9-8f8a-1e831df5b9c7 req-2fff256a-0121-47f9-81c1-bb3016993dc2 service nova] Creating event network-vif-plugged:2b891eeb-973f-492a-9059-55961bb956bf for instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 on user Apr 11 15:35:56 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-3a40b5f0-4204-4ec9-8f8a-1e831df5b9c7 req-2fff256a-0121-47f9-81c1-bb3016993dc2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034020 Apr 11 15:35:56 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 207/611] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:35:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:35:58 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-626bcb3a-fc7d-44c0-86cb-5ff937977fd5 req-1b81c977-c10d-4941-a2ed-3c3d65d01f73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "058df5ba-07ab-4bdd-9a47-907e7b0e0e59", "name": "network-vif-plugged", "status": "completed", "tag": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:35:58 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-626bcb3a-fc7d-44c0-86cb-5ff937977fd5 req-1b81c977-c10d-4941-a2ed-3c3d65d01f73 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:58 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-626bcb3a-fc7d-44c0-86cb-5ff937977fd5 req-1b81c977-c10d-4941-a2ed-3c3d65d01f73 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:58 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-626bcb3a-fc7d-44c0-86cb-5ff937977fd5 req-1b81c977-c10d-4941-a2ed-3c3d65d01f73 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:58 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-626bcb3a-fc7d-44c0-86cb-5ff937977fd5 req-1b81c977-c10d-4941-a2ed-3c3d65d01f73 service nova] Creating event network-vif-plugged:cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 for instance 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 on user Apr 11 15:35:58 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-626bcb3a-fc7d-44c0-86cb-5ff937977fd5 req-1b81c977-c10d-4941-a2ed-3c3d65d01f73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062772 Apr 11 15:35:58 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 203/612] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:35:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:35:58 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-80a03259-e7e2-4f86-aff9-1f65fffc7076 req-2239412d-75ce-4e5c-9b48-923c786b6a6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f6ae64a-c760-4ba3-8a50-d380835d9913", "name": "network-vif-plugged", "status": "completed", "tag": "2b891eeb-973f-492a-9059-55961bb956bf"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:35:58 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-80a03259-e7e2-4f86-aff9-1f65fffc7076 req-2239412d-75ce-4e5c-9b48-923c786b6a6f service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:35:58 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-80a03259-e7e2-4f86-aff9-1f65fffc7076 req-2239412d-75ce-4e5c-9b48-923c786b6a6f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:35:58 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-80a03259-e7e2-4f86-aff9-1f65fffc7076 req-2239412d-75ce-4e5c-9b48-923c786b6a6f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:35:58 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-80a03259-e7e2-4f86-aff9-1f65fffc7076 req-2239412d-75ce-4e5c-9b48-923c786b6a6f service nova] Creating event network-vif-plugged:2b891eeb-973f-492a-9059-55961bb956bf for instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 on user Apr 11 15:35:58 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-80a03259-e7e2-4f86-aff9-1f65fffc7076 req-2239412d-75ce-4e5c-9b48-923c786b6a6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034843 Apr 11 15:35:58 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 203/613] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:35:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:36:00 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-045edf31-1573-4a8e-b8d5-e15ba862f31e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:36:00 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-045edf31-1573-4a8e-b8d5-e15ba862f31e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:36:00 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-045edf31-1573-4a8e-b8d5-e15ba862f31e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:36:00 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-045edf31-1573-4a8e-b8d5-e15ba862f31e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:36:00 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-045edf31-1573-4a8e-b8d5-e15ba862f31e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:36:00 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-045edf31-1573-4a8e-b8d5-e15ba862f31e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:36:00 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-045edf31-1573-4a8e-b8d5-e15ba862f31e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:36:00 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-045edf31-1573-4a8e-b8d5-e15ba862f31e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:36:00 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-b1a27e61-1627-4e2b-a43a-374c9be23dbe req-291dd64d-34c5-424e-b0cd-4efdc92a2487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "058df5ba-07ab-4bdd-9a47-907e7b0e0e59", "name": "network-vif-plugged", "status": "completed", "tag": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:36:00 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-b1a27e61-1627-4e2b-a43a-374c9be23dbe req-291dd64d-34c5-424e-b0cd-4efdc92a2487 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:36:00 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-b1a27e61-1627-4e2b-a43a-374c9be23dbe req-291dd64d-34c5-424e-b0cd-4efdc92a2487 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:36:00 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-b1a27e61-1627-4e2b-a43a-374c9be23dbe req-291dd64d-34c5-424e-b0cd-4efdc92a2487 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:36:00 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-b1a27e61-1627-4e2b-a43a-374c9be23dbe req-291dd64d-34c5-424e-b0cd-4efdc92a2487 service nova] Creating event network-vif-plugged:cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 for instance 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 on user Apr 11 15:36:00 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-b1a27e61-1627-4e2b-a43a-374c9be23dbe req-291dd64d-34c5-424e-b0cd-4efdc92a2487 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034558 Apr 11 15:36:00 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 204/614] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:36:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:36:00 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-045edf31-1573-4a8e-b8d5-e15ba862f31e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:36:00 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-045edf31-1573-4a8e-b8d5-e15ba862f31e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:36:00 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-045edf31-1573-4a8e-b8d5-e15ba862f31e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:36:00 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-045edf31-1573-4a8e-b8d5-e15ba862f31e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59" status: 200 len: 1707 microversion: 2.20 time: 0.161949 Apr 11 15:36:00 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 208/615] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:36:00 2023] GET /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59 => generated 1707 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:36:07 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:36:07 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:36:07 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-f96c44b2-2622-4f57-8349-0944f7ae2eb2 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:36:07 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-f96c44b2-2622-4f57-8349-0944f7ae2eb2 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:36:07 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f96c44b2-2622-4f57-8349-0944f7ae2eb2 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:36:07 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f96c44b2-2622-4f57-8349-0944f7ae2eb2 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:36:07 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f96c44b2-2622-4f57-8349-0944f7ae2eb2 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:36:07 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f96c44b2-2622-4f57-8349-0944f7ae2eb2 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:36:07 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f96c44b2-2622-4f57-8349-0944f7ae2eb2 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:36:07 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f96c44b2-2622-4f57-8349-0944f7ae2eb2 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:36:07 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-f96c44b2-2622-4f57-8349-0944f7ae2eb2 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d09cda86-eca1-4c42-8654-758eb6cd30e0/action" status: 202 len: 0 microversion: 2.87 time: 0.079340 Apr 11 15:36:07 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 204/616] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 15:36:07 2023] POST /compute/v2.1/servers/d09cda86-eca1-4c42-8654-758eb6cd30e0/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:36:07 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:36:07 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-8650d858-f7fe-49df-9f2b-28d2eaa4cbf2 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:36:07 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-8650d858-f7fe-49df-9f2b-28d2eaa4cbf2 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:36:07 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-8650d858-f7fe-49df-9f2b-28d2eaa4cbf2 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:36:07 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-8650d858-f7fe-49df-9f2b-28d2eaa4cbf2 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:36:07 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-8650d858-f7fe-49df-9f2b-28d2eaa4cbf2 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:36:07 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-8650d858-f7fe-49df-9f2b-28d2eaa4cbf2 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:36:07 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-8650d858-f7fe-49df-9f2b-28d2eaa4cbf2 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:36:07 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-8650d858-f7fe-49df-9f2b-28d2eaa4cbf2 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:36:08 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-8650d858-f7fe-49df-9f2b-28d2eaa4cbf2 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:36:08 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-8650d858-f7fe-49df-9f2b-28d2eaa4cbf2 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:36:08 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-8650d858-f7fe-49df-9f2b-28d2eaa4cbf2 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:36:08 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-8650d858-f7fe-49df-9f2b-28d2eaa4cbf2 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d09cda86-eca1-4c42-8654-758eb6cd30e0" status: 200 len: 1761 microversion: 2.87 time: 0.209599 Apr 11 15:36:08 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 205/617] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:36:07 2023] GET /compute/v2.1/servers/d09cda86-eca1-4c42-8654-758eb6cd30e0 => generated 1761 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:36:08 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-d3e45dc3-8652-4cf6-9c9a-147c4d3aba40 req-ec7db6e0-373a-4407-8212-11e8a07ff57c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09cda86-eca1-4c42-8654-758eb6cd30e0", "name": "network-vif-unplugged", "status": "completed", "tag": "27d62f09-c938-4a71-be1e-6dc1d6a47382"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:36:08 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:36:08 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=8 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:36:08 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-d3e45dc3-8652-4cf6-9c9a-147c4d3aba40 req-ec7db6e0-373a-4407-8212-11e8a07ff57c service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:36:08 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-d3e45dc3-8652-4cf6-9c9a-147c4d3aba40 req-ec7db6e0-373a-4407-8212-11e8a07ff57c service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:36:08 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-d3e45dc3-8652-4cf6-9c9a-147c4d3aba40 req-ec7db6e0-373a-4407-8212-11e8a07ff57c service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:36:08 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-d3e45dc3-8652-4cf6-9c9a-147c4d3aba40 req-ec7db6e0-373a-4407-8212-11e8a07ff57c service nova] Creating event network-vif-unplugged:27d62f09-c938-4a71-be1e-6dc1d6a47382 for instance d09cda86-eca1-4c42-8654-758eb6cd30e0 on user Apr 11 15:36:08 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-d3e45dc3-8652-4cf6-9c9a-147c4d3aba40 req-ec7db6e0-373a-4407-8212-11e8a07ff57c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034994 Apr 11 15:36:08 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 209/618] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:36:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:36:10 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-738f6b9b-1e27-4226-a3c5-621f3e49a931 req-716c6e5a-51dc-44f0-9d4b-0274d37d92d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09cda86-eca1-4c42-8654-758eb6cd30e0", "name": "network-vif-plugged", "status": "completed", "tag": "27d62f09-c938-4a71-be1e-6dc1d6a47382"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:36:10 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:36:10 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-738f6b9b-1e27-4226-a3c5-621f3e49a931 req-716c6e5a-51dc-44f0-9d4b-0274d37d92d4 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:36:10 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-738f6b9b-1e27-4226-a3c5-621f3e49a931 req-716c6e5a-51dc-44f0-9d4b-0274d37d92d4 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:36:10 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-738f6b9b-1e27-4226-a3c5-621f3e49a931 req-716c6e5a-51dc-44f0-9d4b-0274d37d92d4 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:36:10 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-738f6b9b-1e27-4226-a3c5-621f3e49a931 req-716c6e5a-51dc-44f0-9d4b-0274d37d92d4 service nova] Creating event network-vif-plugged:27d62f09-c938-4a71-be1e-6dc1d6a47382 for instance d09cda86-eca1-4c42-8654-758eb6cd30e0 on user Apr 11 15:36:10 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-738f6b9b-1e27-4226-a3c5-621f3e49a931 req-716c6e5a-51dc-44f0-9d4b-0274d37d92d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034719 Apr 11 15:36:10 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 205/619] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:36:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:36:12 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-c78f4c5a-02b3-416d-aa74-cd5c2c7c91c8 req-7638238d-22ee-4163-9d8b-6f2b1c519dbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09cda86-eca1-4c42-8654-758eb6cd30e0", "name": "network-vif-plugged", "status": "completed", "tag": "27d62f09-c938-4a71-be1e-6dc1d6a47382"}, {"server_uuid": "d09cda86-eca1-4c42-8654-758eb6cd30e0", "name": "network-vif-plugged", "status": "completed", "tag": "27d62f09-c938-4a71-be1e-6dc1d6a47382"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:36:12 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-c78f4c5a-02b3-416d-aa74-cd5c2c7c91c8 req-7638238d-22ee-4163-9d8b-6f2b1c519dbd service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:36:12 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-c78f4c5a-02b3-416d-aa74-cd5c2c7c91c8 req-7638238d-22ee-4163-9d8b-6f2b1c519dbd service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:36:12 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-c78f4c5a-02b3-416d-aa74-cd5c2c7c91c8 req-7638238d-22ee-4163-9d8b-6f2b1c519dbd service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:36:12 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-c78f4c5a-02b3-416d-aa74-cd5c2c7c91c8 req-7638238d-22ee-4163-9d8b-6f2b1c519dbd service nova] Creating event network-vif-plugged:27d62f09-c938-4a71-be1e-6dc1d6a47382 for instance d09cda86-eca1-4c42-8654-758eb6cd30e0 on user Apr 11 15:36:12 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-c78f4c5a-02b3-416d-aa74-cd5c2c7c91c8 req-7638238d-22ee-4163-9d8b-6f2b1c519dbd service nova] Creating event network-vif-plugged:27d62f09-c938-4a71-be1e-6dc1d6a47382 for instance d09cda86-eca1-4c42-8654-758eb6cd30e0 on user Apr 11 15:36:12 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-c78f4c5a-02b3-416d-aa74-cd5c2c7c91c8 req-7638238d-22ee-4163-9d8b-6f2b1c519dbd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035823 Apr 11 15:36:12 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 206/620] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:36:12 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:36:14 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-99072cc9-dbcf-464e-aafb-8d6e5757ca37 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:36:14 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-99072cc9-dbcf-464e-aafb-8d6e5757ca37 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:36:14 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=4 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:36:14 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-99072cc9-dbcf-464e-aafb-8d6e5757ca37 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:36:14 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-99072cc9-dbcf-464e-aafb-8d6e5757ca37 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:36:14 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-99072cc9-dbcf-464e-aafb-8d6e5757ca37 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:36:14 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-99072cc9-dbcf-464e-aafb-8d6e5757ca37 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:36:14 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-99072cc9-dbcf-464e-aafb-8d6e5757ca37 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:36:14 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-99072cc9-dbcf-464e-aafb-8d6e5757ca37 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:36:14 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=15 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:36:14 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-99072cc9-dbcf-464e-aafb-8d6e5757ca37 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:36:14 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-99072cc9-dbcf-464e-aafb-8d6e5757ca37 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e" status: 200 len: 1540 microversion: 2.1 time: 0.154779 Apr 11 15:36:14 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 210/621] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:36:14 2023] GET /compute/v2.1/servers/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e => generated 1540 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:36:22 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:36:22 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:36:22 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-557f468c-40b1-4d75-944e-b8166a4ceba6 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:36:22 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-557f468c-40b1-4d75-944e-b8166a4ceba6 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:36:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-557f468c-40b1-4d75-944e-b8166a4ceba6 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:36:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-557f468c-40b1-4d75-944e-b8166a4ceba6 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:36:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-557f468c-40b1-4d75-944e-b8166a4ceba6 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:36:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-557f468c-40b1-4d75-944e-b8166a4ceba6 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:36:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-557f468c-40b1-4d75-944e-b8166a4ceba6 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:36:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-557f468c-40b1-4d75-944e-b8166a4ceba6 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:36:23 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-557f468c-40b1-4d75-944e-b8166a4ceba6 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402ec212c8a64a559f82c166070a92ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f7abe5e3144c7ab354ffaba1748616', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:36:23 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-557f468c-40b1-4d75-944e-b8166a4ceba6 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f34c2249-840e-4475-87e6-648d173bc7ed" status: 200 len: 1538 microversion: 2.1 time: 0.171953 Apr 11 15:36:23 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 206/622] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:36:22 2023] GET /compute/v2.1/servers/f34c2249-840e-4475-87e6-648d173bc7ed => generated 1538 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:36:24 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=15 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:36:24 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=13 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:36:24 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-1e28308e-0adf-4601-9a45-8ac51335ab6f req-da511fd0-ba31-4e88-bdfb-1a1ac92d3734 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f34c2249-840e-4475-87e6-648d173bc7ed", "tag": "dc2a981c-9e15-473f-8bd6-c4c312b107d1"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:36:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-1e28308e-0adf-4601-9a45-8ac51335ab6f req-da511fd0-ba31-4e88-bdfb-1a1ac92d3734 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:36:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-1e28308e-0adf-4601-9a45-8ac51335ab6f req-da511fd0-ba31-4e88-bdfb-1a1ac92d3734 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:36:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-1e28308e-0adf-4601-9a45-8ac51335ab6f req-da511fd0-ba31-4e88-bdfb-1a1ac92d3734 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:36:24 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-1e28308e-0adf-4601-9a45-8ac51335ab6f req-da511fd0-ba31-4e88-bdfb-1a1ac92d3734 service nova] Creating event network-changed:dc2a981c-9e15-473f-8bd6-c4c312b107d1 for instance f34c2249-840e-4475-87e6-648d173bc7ed on user Apr 11 15:36:25 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-1e28308e-0adf-4601-9a45-8ac51335ab6f req-da511fd0-ba31-4e88-bdfb-1a1ac92d3734 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038975 Apr 11 15:36:25 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 207/623] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:36:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:36:25 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3"}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:36:25 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:36:25 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:36:25 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=5 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:36:25 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:36:25 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:36:25 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:36:25 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:36:25 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:36:25 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:36:25 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f34c2249-840e-4475-87e6-648d173bc7ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.452904 Apr 11 15:36:25 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 211/624] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 15:36:25 2023] POST /compute/v2.1/servers/f34c2249-840e-4475-87e6-648d173bc7ed/os-volume_attachments => generated 194 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:36:30 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-8f40141e-e574-4f94-a08f-76796060eed2 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:36:30 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-8f40141e-e574-4f94-a08f-76796060eed2 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:36:30 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8f40141e-e574-4f94-a08f-76796060eed2 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:36:30 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8f40141e-e574-4f94-a08f-76796060eed2 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:36:30 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8f40141e-e574-4f94-a08f-76796060eed2 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:36:30 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8f40141e-e574-4f94-a08f-76796060eed2 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:36:30 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8f40141e-e574-4f94-a08f-76796060eed2 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:36:30 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8f40141e-e574-4f94-a08f-76796060eed2 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:36:30 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-8f40141e-e574-4f94-a08f-76796060eed2 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044f17aee3324b3a97bebe935548b3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23461a3d7ca49f6a77d3fde6f1009d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:36:30 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-8f40141e-e574-4f94-a08f-76796060eed2 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8" status: 200 len: 1537 microversion: 2.1 time: 0.151335 Apr 11 15:36:30 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 207/625] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:36:30 2023] GET /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8 => generated 1537 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:36:33 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:36:33 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:36:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:36:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:36:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:36:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:36:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:36:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:36:33 user devstack@n-api.service[61165]: DEBUG nova.objects.instance [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lazy-loading 'services' on Instance uuid f34c2249-840e-4475-87e6-648d173bc7ed {{(pid=61165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 15:36:33 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f34c2249-840e-4475-87e6-648d173bc7ed/os-volume_attachments/dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3" status: 202 len: 0 microversion: 2.1 time: 0.256879 Apr 11 15:36:33 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 208/626] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 15:36:33 2023] DELETE /compute/v2.1/servers/f34c2249-840e-4475-87e6-648d173bc7ed/os-volume_attachments/dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:36:33 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-c7a8d94c-0d8d-4bec-95a7-3556035bb873 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:36:33 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-c7a8d94c-0d8d-4bec-95a7-3556035bb873 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:36:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c7a8d94c-0d8d-4bec-95a7-3556035bb873 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:36:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c7a8d94c-0d8d-4bec-95a7-3556035bb873 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:36:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c7a8d94c-0d8d-4bec-95a7-3556035bb873 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:36:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c7a8d94c-0d8d-4bec-95a7-3556035bb873 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:36:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c7a8d94c-0d8d-4bec-95a7-3556035bb873 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:36:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c7a8d94c-0d8d-4bec-95a7-3556035bb873 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:36:33 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-c7a8d94c-0d8d-4bec-95a7-3556035bb873 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f34c2249-840e-4475-87e6-648d173bc7ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046630 Apr 11 15:36:33 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 212/627] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:36:33 2023] GET /compute/v2.1/servers/f34c2249-840e-4475-87e6-648d173bc7ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:36:42 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-e40ad878-6800-44d8-aa59-2a720740a1a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:36:42 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-e40ad878-6800-44d8-aa59-2a720740a1a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:36:42 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:36:42 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=12 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:36:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e40ad878-6800-44d8-aa59-2a720740a1a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:36:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e40ad878-6800-44d8-aa59-2a720740a1a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:36:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e40ad878-6800-44d8-aa59-2a720740a1a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:36:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e40ad878-6800-44d8-aa59-2a720740a1a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:36:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e40ad878-6800-44d8-aa59-2a720740a1a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:36:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e40ad878-6800-44d8-aa59-2a720740a1a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:36:42 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-e40ad878-6800-44d8-aa59-2a720740a1a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8492f96e5d4f54aaae3679c82b6759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd700a53aa25849e0afd562b05881d09a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:36:42 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-e40ad878-6800-44d8-aa59-2a720740a1a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/058df5ba-07ab-4bdd-9a47-907e7b0e0e59" status: 200 len: 1504 microversion: 2.1 time: 0.141241 Apr 11 15:36:42 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 208/628] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:36:42 2023] GET /compute/v2.1/servers/058df5ba-07ab-4bdd-9a47-907e7b0e0e59 => generated 1504 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:36:58 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:36:58 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:36:58 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-458e1d37-a069-415b-a10a-be5603f10948 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:36:58 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-458e1d37-a069-415b-a10a-be5603f10948 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:36:58 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-458e1d37-a069-415b-a10a-be5603f10948 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:36:58 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-458e1d37-a069-415b-a10a-be5603f10948 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:36:58 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-458e1d37-a069-415b-a10a-be5603f10948 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:36:58 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-458e1d37-a069-415b-a10a-be5603f10948 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:36:58 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-458e1d37-a069-415b-a10a-be5603f10948 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:36:58 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-458e1d37-a069-415b-a10a-be5603f10948 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:36:58 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-458e1d37-a069-415b-a10a-be5603f10948 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:36:58 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-458e1d37-a069-415b-a10a-be5603f10948 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:36:58 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-458e1d37-a069-415b-a10a-be5603f10948 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:36:58 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-458e1d37-a069-415b-a10a-be5603f10948 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d09cda86-eca1-4c42-8654-758eb6cd30e0" status: 200 len: 1767 microversion: 2.87 time: 0.214378 Apr 11 15:36:58 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 209/629] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:36:58 2023] GET /compute/v2.1/servers/d09cda86-eca1-4c42-8654-758eb6cd30e0 => generated 1767 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:37:00 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-0d3d0169-7cf3-4623-9fdf-0361fb5fefeb tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:37:00 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-0d3d0169-7cf3-4623-9fdf-0361fb5fefeb tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:37:00 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=4 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:37:00 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:37:00 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-0d3d0169-7cf3-4623-9fdf-0361fb5fefeb tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:00 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-0d3d0169-7cf3-4623-9fdf-0361fb5fefeb tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:00 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-0d3d0169-7cf3-4623-9fdf-0361fb5fefeb tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:00 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-0d3d0169-7cf3-4623-9fdf-0361fb5fefeb tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:00 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-0d3d0169-7cf3-4623-9fdf-0361fb5fefeb tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:00 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-0d3d0169-7cf3-4623-9fdf-0361fb5fefeb tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:00 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-0d3d0169-7cf3-4623-9fdf-0361fb5fefeb tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048166 Apr 11 15:37:00 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 213/630] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Apr 11 15:37:00 2023] GET /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:37:01 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:37:01 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:37:01 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:37:01 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:37:01 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:01 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:01 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:01 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:01 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:01 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:01 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Going to try to terminate instance {{(pid=61166) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:37:01 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59" status: 204 len: 0 microversion: 2.20 time: 0.117511 Apr 11 15:37:01 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 209/631] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 15:37:01 2023] DELETE /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 15:37:01 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-d3a543b0-69f4-40bf-bbcf-5588d5e8e67a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:37:01 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-d3a543b0-69f4-40bf-bbcf-5588d5e8e67a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:37:01 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d3a543b0-69f4-40bf-bbcf-5588d5e8e67a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:01 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d3a543b0-69f4-40bf-bbcf-5588d5e8e67a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:01 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d3a543b0-69f4-40bf-bbcf-5588d5e8e67a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:01 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d3a543b0-69f4-40bf-bbcf-5588d5e8e67a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:01 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d3a543b0-69f4-40bf-bbcf-5588d5e8e67a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:01 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d3a543b0-69f4-40bf-bbcf-5588d5e8e67a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:01 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-d3a543b0-69f4-40bf-bbcf-5588d5e8e67a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:37:01 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-d3a543b0-69f4-40bf-bbcf-5588d5e8e67a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:37:01 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-d3a543b0-69f4-40bf-bbcf-5588d5e8e67a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:37:01 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-d3a543b0-69f4-40bf-bbcf-5588d5e8e67a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59" status: 200 len: 1713 microversion: 2.20 time: 0.192283 Apr 11 15:37:01 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 210/632] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:37:01 2023] GET /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59 => generated 1713 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:37:01 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-594576bd-c782-4264-9b9f-6dd9b3a701d0 req-87279be1-d7cc-4049-b4ca-12182f7e9585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc25fc1-e59f-42c8-a371-b4b12e17fd59", "name": "network-vif-unplugged", "status": "completed", "tag": "3ae0cd28-c459-47b7-be17-133b69773f9c"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:37:01 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-594576bd-c782-4264-9b9f-6dd9b3a701d0 req-87279be1-d7cc-4049-b4ca-12182f7e9585 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:01 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-594576bd-c782-4264-9b9f-6dd9b3a701d0 req-87279be1-d7cc-4049-b4ca-12182f7e9585 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:01 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-594576bd-c782-4264-9b9f-6dd9b3a701d0 req-87279be1-d7cc-4049-b4ca-12182f7e9585 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:01 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-594576bd-c782-4264-9b9f-6dd9b3a701d0 req-87279be1-d7cc-4049-b4ca-12182f7e9585 service nova] Creating event network-vif-unplugged:3ae0cd28-c459-47b7-be17-133b69773f9c for instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 on user Apr 11 15:37:01 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-594576bd-c782-4264-9b9f-6dd9b3a701d0 req-87279be1-d7cc-4049-b4ca-12182f7e9585 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097584 Apr 11 15:37:01 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 214/633] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:37:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:37:03 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-e0dcf8e0-d4c9-470d-be52-7f1abf4cd745 req-4ea25a15-e5a7-471a-ab41-bbd157347bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc25fc1-e59f-42c8-a371-b4b12e17fd59", "name": "network-vif-plugged", "status": "completed", "tag": "3ae0cd28-c459-47b7-be17-133b69773f9c"}, {"server_uuid": "ffc25fc1-e59f-42c8-a371-b4b12e17fd59", "name": "network-vif-deleted", "tag": "3ae0cd28-c459-47b7-be17-133b69773f9c"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:37:03 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-e0dcf8e0-d4c9-470d-be52-7f1abf4cd745 req-4ea25a15-e5a7-471a-ab41-bbd157347bc5 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:03 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-e0dcf8e0-d4c9-470d-be52-7f1abf4cd745 req-4ea25a15-e5a7-471a-ab41-bbd157347bc5 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:03 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-e0dcf8e0-d4c9-470d-be52-7f1abf4cd745 req-4ea25a15-e5a7-471a-ab41-bbd157347bc5 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:03 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-e0dcf8e0-d4c9-470d-be52-7f1abf4cd745 req-4ea25a15-e5a7-471a-ab41-bbd157347bc5 service nova] Creating event network-vif-plugged:3ae0cd28-c459-47b7-be17-133b69773f9c for instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 on user Apr 11 15:37:03 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-e0dcf8e0-d4c9-470d-be52-7f1abf4cd745 req-4ea25a15-e5a7-471a-ab41-bbd157347bc5 service nova] Creating event network-vif-deleted:3ae0cd28-c459-47b7-be17-133b69773f9c for instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 on user Apr 11 15:37:03 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-e0dcf8e0-d4c9-470d-be52-7f1abf4cd745 req-4ea25a15-e5a7-471a-ab41-bbd157347bc5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030329 Apr 11 15:37:03 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 210/634] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:37:03 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:37:14 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:37:14 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=12 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:37:14 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-46c425cc-5419-4f66-917b-0151d8637a83 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:37:14 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-46c425cc-5419-4f66-917b-0151d8637a83 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:37:14 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-46c425cc-5419-4f66-917b-0151d8637a83 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:14 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-46c425cc-5419-4f66-917b-0151d8637a83 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:14 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-46c425cc-5419-4f66-917b-0151d8637a83 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:14 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-46c425cc-5419-4f66-917b-0151d8637a83 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:14 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-46c425cc-5419-4f66-917b-0151d8637a83 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:14 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-46c425cc-5419-4f66-917b-0151d8637a83 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:14 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-46c425cc-5419-4f66-917b-0151d8637a83 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.210599 Apr 11 15:37:14 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 211/635] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 15:37:14 2023] GET /compute/v2.1/servers/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/os-interface => generated 283 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 15:37:15 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=4 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:37:15 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=8 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:37:15 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-fefd8e3f-49bc-4895-8dd6-ae973a3259f8 req-230b15d3-a4f1-4778-bd43-d64984a7fad0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcbfcbfd-7e96-4271-94ee-60ef937e3b7e", "tag": "32c006ee-14e2-47d8-b999-bafc729aa67a"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:37:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-fefd8e3f-49bc-4895-8dd6-ae973a3259f8 req-230b15d3-a4f1-4778-bd43-d64984a7fad0 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-fefd8e3f-49bc-4895-8dd6-ae973a3259f8 req-230b15d3-a4f1-4778-bd43-d64984a7fad0 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-fefd8e3f-49bc-4895-8dd6-ae973a3259f8 req-230b15d3-a4f1-4778-bd43-d64984a7fad0 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:15 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-fefd8e3f-49bc-4895-8dd6-ae973a3259f8 req-230b15d3-a4f1-4778-bd43-d64984a7fad0 service nova] Creating event network-changed:32c006ee-14e2-47d8-b999-bafc729aa67a for instance dcbfcbfd-7e96-4271-94ee-60ef937e3b7e on user Apr 11 15:37:15 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-fefd8e3f-49bc-4895-8dd6-ae973a3259f8 req-230b15d3-a4f1-4778-bd43-d64984a7fad0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084279 Apr 11 15:37:15 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 215/636] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:37:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:37:17 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:37:17 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:37:17 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-794339141", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "1bd215e8-0459-4dd2-893b-096b6e31ac08"}], "security_groups": [{"name": "tempest-securitygroup--1617652564"}], "key_name": "tempest-keypair-1137963694", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "98d29c73-7b06-45f4-90e0-01a41825cc68", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:37:17 user devstack@n-api.service[61166]: DEBUG nova.network.neutron [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] validate_networks() for [('1bd215e8-0459-4dd2-893b-096b6e31ac08', None, None, None, None, None)] {{(pid=61166) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:37:17 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Flavor limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:37:17 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Image limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:37:17 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Flavor pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:37:17 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Image pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:37:17 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:37:17 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:17 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:17 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:17 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:17 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:17 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:18 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Getting quotas for project bb7660e8f76b471487136806ee9eec62. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:37:18 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Getting quotas for user 10720df0ac4f4e62a0a5c9883d600add and project bb7660e8f76b471487136806ee9eec62. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:37:18 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Going to run 1 instances... {{(pid=61166) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:37:18 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='98d29c73-7b06-45f4-90e0-01a41825cc68',volume_size=None,volume_type=None)] {{(pid=61166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:37:18 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.749076 Apr 11 15:37:18 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 211/637] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 15:37:17 2023] POST /compute/v2.1/servers => generated 404 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 15:37:18 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-d87627c8-55e3-472e-9d6d-92623bef79d2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:37:18 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-d87627c8-55e3-472e-9d6d-92623bef79d2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:37:18 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-d87627c8-55e3-472e-9d6d-92623bef79d2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:37:18 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-d87627c8-55e3-472e-9d6d-92623bef79d2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4" status: 200 len: 1075 microversion: 2.1 time: 0.066113 Apr 11 15:37:18 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 212/638] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:37:18 2023] GET /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4 => generated 1075 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:37:20 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-144460be-ccdb-4403-9053-5616d0dea725 req-9ea8f14f-abea-464e-8d3d-14d4dd0da838 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffce2921-d4a5-4bcb-8032-62a6dc321fb4", "tag": "910fb3d4-3965-41a2-8f97-9de79ee78c78"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:37:20 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-144460be-ccdb-4403-9053-5616d0dea725 req-9ea8f14f-abea-464e-8d3d-14d4dd0da838 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:20 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-144460be-ccdb-4403-9053-5616d0dea725 req-9ea8f14f-abea-464e-8d3d-14d4dd0da838 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:20 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-144460be-ccdb-4403-9053-5616d0dea725 req-9ea8f14f-abea-464e-8d3d-14d4dd0da838 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:20 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-144460be-ccdb-4403-9053-5616d0dea725 req-9ea8f14f-abea-464e-8d3d-14d4dd0da838 service nova] Creating event network-changed:910fb3d4-3965-41a2-8f97-9de79ee78c78 for instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 on user Apr 11 15:37:20 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-144460be-ccdb-4403-9053-5616d0dea725 req-9ea8f14f-abea-464e-8d3d-14d4dd0da838 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045836 Apr 11 15:37:20 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 216/639] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:37:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:37:23 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-b818360d-1e68-4168-a4ca-7e53f3fd68da tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:37:23 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-b818360d-1e68-4168-a4ca-7e53f3fd68da tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:37:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b818360d-1e68-4168-a4ca-7e53f3fd68da tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b818360d-1e68-4168-a4ca-7e53f3fd68da tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b818360d-1e68-4168-a4ca-7e53f3fd68da tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b818360d-1e68-4168-a4ca-7e53f3fd68da tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b818360d-1e68-4168-a4ca-7e53f3fd68da tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b818360d-1e68-4168-a4ca-7e53f3fd68da tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:24 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-b818360d-1e68-4168-a4ca-7e53f3fd68da tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f34c2249-840e-4475-87e6-648d173bc7ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055496 Apr 11 15:37:24 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 212/640] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:37:23 2023] GET /compute/v2.1/servers/f34c2249-840e-4475-87e6-648d173bc7ed/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 15:37:24 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:37:24 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:37:24 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:37:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:24 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Going to try to terminate instance {{(pid=61165) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:37:24 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-5e6220a7-6ea7-441d-abb5-6fe3a367519e req-cfcae1e2-f73c-40ae-9264-4cda63571865 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f34c2249-840e-4475-87e6-648d173bc7ed", "tag": "dc2a981c-9e15-473f-8bd6-c4c312b107d1"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:37:24 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-5e6220a7-6ea7-441d-abb5-6fe3a367519e req-cfcae1e2-f73c-40ae-9264-4cda63571865 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:24 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-5e6220a7-6ea7-441d-abb5-6fe3a367519e req-cfcae1e2-f73c-40ae-9264-4cda63571865 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:24 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-5e6220a7-6ea7-441d-abb5-6fe3a367519e req-cfcae1e2-f73c-40ae-9264-4cda63571865 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:24 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-5e6220a7-6ea7-441d-abb5-6fe3a367519e req-cfcae1e2-f73c-40ae-9264-4cda63571865 service nova] Creating event network-changed:dc2a981c-9e15-473f-8bd6-c4c312b107d1 for instance f34c2249-840e-4475-87e6-648d173bc7ed on user Apr 11 15:37:24 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-5e6220a7-6ea7-441d-abb5-6fe3a367519e req-cfcae1e2-f73c-40ae-9264-4cda63571865 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083905 Apr 11 15:37:24 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 217/641] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:37:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:37:24 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f34c2249-840e-4475-87e6-648d173bc7ed" status: 204 len: 0 microversion: 2.1 time: 0.165521 Apr 11 15:37:24 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 213/642] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:37:24 2023] DELETE /compute/v2.1/servers/f34c2249-840e-4475-87e6-648d173bc7ed => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:37:24 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-807e722b-f1c0-468e-aae2-db8587c19cff tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:37:24 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-807e722b-f1c0-468e-aae2-db8587c19cff tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:37:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-807e722b-f1c0-468e-aae2-db8587c19cff tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-807e722b-f1c0-468e-aae2-db8587c19cff tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-807e722b-f1c0-468e-aae2-db8587c19cff tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-807e722b-f1c0-468e-aae2-db8587c19cff tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-807e722b-f1c0-468e-aae2-db8587c19cff tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-807e722b-f1c0-468e-aae2-db8587c19cff tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:25 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-807e722b-f1c0-468e-aae2-db8587c19cff tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402ec212c8a64a559f82c166070a92ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f7abe5e3144c7ab354ffaba1748616', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:37:25 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-807e722b-f1c0-468e-aae2-db8587c19cff tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f34c2249-840e-4475-87e6-648d173bc7ed" status: 200 len: 1663 microversion: 2.1 time: 0.202235 Apr 11 15:37:25 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 213/643] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:37:24 2023] GET /compute/v2.1/servers/f34c2249-840e-4475-87e6-648d173bc7ed => generated 1663 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:37:26 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-28a2aad1-e08c-4ae4-b20e-97f8e80fe5cf req-55376843-d23a-4819-be0a-9274e2d5c608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f34c2249-840e-4475-87e6-648d173bc7ed", "name": "network-vif-deleted", "tag": "dc2a981c-9e15-473f-8bd6-c4c312b107d1"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:37:26 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-28a2aad1-e08c-4ae4-b20e-97f8e80fe5cf req-55376843-d23a-4819-be0a-9274e2d5c608 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:26 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-28a2aad1-e08c-4ae4-b20e-97f8e80fe5cf req-55376843-d23a-4819-be0a-9274e2d5c608 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:26 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-28a2aad1-e08c-4ae4-b20e-97f8e80fe5cf req-55376843-d23a-4819-be0a-9274e2d5c608 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:26 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-28a2aad1-e08c-4ae4-b20e-97f8e80fe5cf req-55376843-d23a-4819-be0a-9274e2d5c608 service nova] Creating event network-vif-deleted:dc2a981c-9e15-473f-8bd6-c4c312b107d1 for instance f34c2249-840e-4475-87e6-648d173bc7ed on user Apr 11 15:37:26 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-28a2aad1-e08c-4ae4-b20e-97f8e80fe5cf req-55376843-d23a-4819-be0a-9274e2d5c608 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037315 Apr 11 15:37:26 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 218/644] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:37:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:37:26 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-ec294973-191c-43bf-9f14-17b89a290703 req-37310beb-dd9e-44aa-97d9-3ae016909c6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f34c2249-840e-4475-87e6-648d173bc7ed", "name": "network-vif-unplugged", "status": "completed", "tag": "dc2a981c-9e15-473f-8bd6-c4c312b107d1"}, {"server_uuid": "f34c2249-840e-4475-87e6-648d173bc7ed", "name": "network-vif-plugged", "status": "completed", "tag": "dc2a981c-9e15-473f-8bd6-c4c312b107d1"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:37:26 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-ec294973-191c-43bf-9f14-17b89a290703 req-37310beb-dd9e-44aa-97d9-3ae016909c6f service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:26 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-ec294973-191c-43bf-9f14-17b89a290703 req-37310beb-dd9e-44aa-97d9-3ae016909c6f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:26 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-ec294973-191c-43bf-9f14-17b89a290703 req-37310beb-dd9e-44aa-97d9-3ae016909c6f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:26 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-ec294973-191c-43bf-9f14-17b89a290703 req-37310beb-dd9e-44aa-97d9-3ae016909c6f service nova] Creating event network-vif-unplugged:dc2a981c-9e15-473f-8bd6-c4c312b107d1 for instance f34c2249-840e-4475-87e6-648d173bc7ed on user Apr 11 15:37:26 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-ec294973-191c-43bf-9f14-17b89a290703 req-37310beb-dd9e-44aa-97d9-3ae016909c6f service nova] Creating event network-vif-plugged:dc2a981c-9e15-473f-8bd6-c4c312b107d1 for instance f34c2249-840e-4475-87e6-648d173bc7ed on user Apr 11 15:37:26 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-ec294973-191c-43bf-9f14-17b89a290703 req-37310beb-dd9e-44aa-97d9-3ae016909c6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.049196 Apr 11 15:37:26 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 214/645] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:37:26 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:37:28 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-3b46c809-3038-449d-ae95-7ee17796da2b req-54b87246-19d8-4209-a580-983e6e25b93b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffce2921-d4a5-4bcb-8032-62a6dc321fb4", "name": "network-vif-plugged", "status": "completed", "tag": "910fb3d4-3965-41a2-8f97-9de79ee78c78"}, {"server_uuid": "ffce2921-d4a5-4bcb-8032-62a6dc321fb4", "name": "network-vif-plugged", "status": "completed", "tag": "910fb3d4-3965-41a2-8f97-9de79ee78c78"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:37:28 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:37:28 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:37:28 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-3b46c809-3038-449d-ae95-7ee17796da2b req-54b87246-19d8-4209-a580-983e6e25b93b service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:28 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-3b46c809-3038-449d-ae95-7ee17796da2b req-54b87246-19d8-4209-a580-983e6e25b93b service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:28 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-3b46c809-3038-449d-ae95-7ee17796da2b req-54b87246-19d8-4209-a580-983e6e25b93b service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:28 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-3b46c809-3038-449d-ae95-7ee17796da2b req-54b87246-19d8-4209-a580-983e6e25b93b service nova] Creating event network-vif-plugged:910fb3d4-3965-41a2-8f97-9de79ee78c78 for instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 on user Apr 11 15:37:28 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-3b46c809-3038-449d-ae95-7ee17796da2b req-54b87246-19d8-4209-a580-983e6e25b93b service nova] Creating event network-vif-plugged:910fb3d4-3965-41a2-8f97-9de79ee78c78 for instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 on user Apr 11 15:37:28 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-3b46c809-3038-449d-ae95-7ee17796da2b req-54b87246-19d8-4209-a580-983e6e25b93b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045103 Apr 11 15:37:28 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 214/646] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:37:28 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:37:30 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-e78793f0-7b33-4231-bd34-02cdcc3d3c18 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:37:30 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-e78793f0-7b33-4231-bd34-02cdcc3d3c18 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:37:30 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e78793f0-7b33-4231-bd34-02cdcc3d3c18 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:30 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e78793f0-7b33-4231-bd34-02cdcc3d3c18 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:30 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e78793f0-7b33-4231-bd34-02cdcc3d3c18 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:30 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e78793f0-7b33-4231-bd34-02cdcc3d3c18 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:30 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e78793f0-7b33-4231-bd34-02cdcc3d3c18 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:30 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e78793f0-7b33-4231-bd34-02cdcc3d3c18 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:30 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-e78793f0-7b33-4231-bd34-02cdcc3d3c18 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044f17aee3324b3a97bebe935548b3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23461a3d7ca49f6a77d3fde6f1009d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:37:30 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-e78793f0-7b33-4231-bd34-02cdcc3d3c18 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8" status: 200 len: 1537 microversion: 2.1 time: 0.234183 Apr 11 15:37:30 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 219/647] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:37:30 2023] GET /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8 => generated 1537 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:37:30 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:37:30 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-49971d98-c386-4216-a92d-99b4c25a5d6f tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:37:30 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-49971d98-c386-4216-a92d-99b4c25a5d6f tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '044f17aee3324b3a97bebe935548b3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23461a3d7ca49f6a77d3fde6f1009d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:37:30 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-49971d98-c386-4216-a92d-99b4c25a5d6f tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Searching by: {'deleted': False, 'project_id': 'c23461a3d7ca49f6a77d3fde6f1009d3'} {{(pid=61165) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 11 15:37:31 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-49971d98-c386-4216-a92d-99b4c25a5d6f tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:31 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-49971d98-c386-4216-a92d-99b4c25a5d6f tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:31 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-49971d98-c386-4216-a92d-99b4c25a5d6f tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:31 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-49971d98-c386-4216-a92d-99b4c25a5d6f tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:31 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-49971d98-c386-4216-a92d-99b4c25a5d6f tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:31 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-49971d98-c386-4216-a92d-99b4c25a5d6f tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:31 user devstack@n-api.service[61165]: DEBUG nova.compute.multi_cell_list [None req-49971d98-c386-4216-a92d-99b4c25a5d6f tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61165) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 11 15:37:31 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-49971d98-c386-4216-a92d-99b4c25a5d6f tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.212649 Apr 11 15:37:31 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 215/648] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Apr 11 15:37:30 2023] GET /compute/v2.1/servers => generated 341 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:37:31 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-17450dec-eec3-4ed7-a8a1-2d4bc3c3d6a5 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:37:31 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-17450dec-eec3-4ed7-a8a1-2d4bc3c3d6a5 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:37:31 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-17450dec-eec3-4ed7-a8a1-2d4bc3c3d6a5 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:31 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-17450dec-eec3-4ed7-a8a1-2d4bc3c3d6a5 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:31 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-17450dec-eec3-4ed7-a8a1-2d4bc3c3d6a5 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:31 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-17450dec-eec3-4ed7-a8a1-2d4bc3c3d6a5 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:31 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-17450dec-eec3-4ed7-a8a1-2d4bc3c3d6a5 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:31 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-17450dec-eec3-4ed7-a8a1-2d4bc3c3d6a5 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:31 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-17450dec-eec3-4ed7-a8a1-2d4bc3c3d6a5 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044f17aee3324b3a97bebe935548b3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23461a3d7ca49f6a77d3fde6f1009d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:37:31 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-17450dec-eec3-4ed7-a8a1-2d4bc3c3d6a5 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8" status: 200 len: 1537 microversion: 2.1 time: 0.148546 Apr 11 15:37:31 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 215/649] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:37:31 2023] GET /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8 => generated 1537 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:37:32 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6119ec74-db79-4b19-9bf7-44cc8a4d853a"}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:37:32 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:37:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:33 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269717 Apr 11 15:37:33 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 220/650] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 15:37:32 2023] POST /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:37:41 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-2c4fe808-5594-4268-a2d3-200a3261ee2d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:37:41 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-2c4fe808-5594-4268-a2d3-200a3261ee2d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:37:41 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:37:41 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:37:41 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-2c4fe808-5594-4268-a2d3-200a3261ee2d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:41 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-2c4fe808-5594-4268-a2d3-200a3261ee2d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:41 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-2c4fe808-5594-4268-a2d3-200a3261ee2d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:41 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-2c4fe808-5594-4268-a2d3-200a3261ee2d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:41 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-2c4fe808-5594-4268-a2d3-200a3261ee2d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:41 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-2c4fe808-5594-4268-a2d3-200a3261ee2d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:41 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-2c4fe808-5594-4268-a2d3-200a3261ee2d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044f17aee3324b3a97bebe935548b3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23461a3d7ca49f6a77d3fde6f1009d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:37:41 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-2c4fe808-5594-4268-a2d3-200a3261ee2d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8" status: 200 len: 1583 microversion: 2.1 time: 0.156476 Apr 11 15:37:41 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 216/651] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:37:41 2023] GET /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8 => generated 1583 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:37:42 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-a0526ff4-bc43-404a-8268-72debdee6636 req-fd4c5c4b-18c1-4e32-942b-d84e973acdc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e3d0956-d528-4097-a200-d9b2b6ce7aa8", "tag": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:37:42 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:37:42 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=22 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:37:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-a0526ff4-bc43-404a-8268-72debdee6636 req-fd4c5c4b-18c1-4e32-942b-d84e973acdc8 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-a0526ff4-bc43-404a-8268-72debdee6636 req-fd4c5c4b-18c1-4e32-942b-d84e973acdc8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-a0526ff4-bc43-404a-8268-72debdee6636 req-fd4c5c4b-18c1-4e32-942b-d84e973acdc8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:42 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-a0526ff4-bc43-404a-8268-72debdee6636 req-fd4c5c4b-18c1-4e32-942b-d84e973acdc8 service nova] Creating event network-changed:19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 for instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 on user Apr 11 15:37:42 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-a0526ff4-bc43-404a-8268-72debdee6636 req-fd4c5c4b-18c1-4e32-942b-d84e973acdc8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044295 Apr 11 15:37:42 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 216/652] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:37:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:37:42 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=12 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:37:42 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:37:42 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:37:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:43 user devstack@n-api.service[61167]: DEBUG nova.objects.instance [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'flavor' on Instance uuid 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 {{(pid=61167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 15:37:43 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "POST /compute/v2.1/servers/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/action" status: 200 len: 32 microversion: 2.1 time: 0.109529 Apr 11 15:37:43 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 221/653] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 15:37:42 2023] POST /compute/v2.1/servers/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/action => generated 32 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 15:37:43 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-211ba201-e102-44f1-b217-e7498560a240 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:37:43 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-211ba201-e102-44f1-b217-e7498560a240 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:37:43 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-211ba201-e102-44f1-b217-e7498560a240 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:43 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-211ba201-e102-44f1-b217-e7498560a240 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:43 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-211ba201-e102-44f1-b217-e7498560a240 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:43 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-211ba201-e102-44f1-b217-e7498560a240 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:43 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-211ba201-e102-44f1-b217-e7498560a240 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:43 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-211ba201-e102-44f1-b217-e7498560a240 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:43 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-211ba201-e102-44f1-b217-e7498560a240 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8492f96e5d4f54aaae3679c82b6759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd700a53aa25849e0afd562b05881d09a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:37:43 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-211ba201-e102-44f1-b217-e7498560a240 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/058df5ba-07ab-4bdd-9a47-907e7b0e0e59" status: 200 len: 1510 microversion: 2.1 time: 0.214824 Apr 11 15:37:43 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 217/654] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:37:43 2023] GET /compute/v2.1/servers/058df5ba-07ab-4bdd-9a47-907e7b0e0e59 => generated 1510 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:37:44 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-e407d68f-6e41-4f58-973a-c79018c1e3d6 req-802c2b4a-78ed-4d2d-ab92-a800e31d3bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "058df5ba-07ab-4bdd-9a47-907e7b0e0e59", "name": "network-vif-unplugged", "status": "completed", "tag": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:37:44 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-e407d68f-6e41-4f58-973a-c79018c1e3d6 req-802c2b4a-78ed-4d2d-ab92-a800e31d3bd5 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:44 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-e407d68f-6e41-4f58-973a-c79018c1e3d6 req-802c2b4a-78ed-4d2d-ab92-a800e31d3bd5 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:44 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-e407d68f-6e41-4f58-973a-c79018c1e3d6 req-802c2b4a-78ed-4d2d-ab92-a800e31d3bd5 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:44 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-e407d68f-6e41-4f58-973a-c79018c1e3d6 req-802c2b4a-78ed-4d2d-ab92-a800e31d3bd5 service nova] Creating event network-vif-unplugged:cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 for instance 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 on user Apr 11 15:37:44 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-e407d68f-6e41-4f58-973a-c79018c1e3d6 req-802c2b4a-78ed-4d2d-ab92-a800e31d3bd5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043397 Apr 11 15:37:44 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 217/655] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:37:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:37:44 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-c3b28138-6350-4814-91cb-a7c7a706da6e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1561016162"}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:37:44 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-c3b28138-6350-4814-91cb-a7c7a706da6e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:37:44 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c3b28138-6350-4814-91cb-a7c7a706da6e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:44 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c3b28138-6350-4814-91cb-a7c7a706da6e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:44 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c3b28138-6350-4814-91cb-a7c7a706da6e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:44 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c3b28138-6350-4814-91cb-a7c7a706da6e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:44 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c3b28138-6350-4814-91cb-a7c7a706da6e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:44 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c3b28138-6350-4814-91cb-a7c7a706da6e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:44 user devstack@n-api.service[61167]: INFO nova.network.security_group_api [None req-c3b28138-6350-4814-91cb-a7c7a706da6e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Adding security group ca3e544b-3cf1-409d-b659-b416a021176f to port 19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 Apr 11 15:37:45 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-c3b28138-6350-4814-91cb-a7c7a706da6e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/action" status: 202 len: 0 microversion: 2.1 time: 0.586824 Apr 11 15:37:45 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 222/656] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 15:37:44 2023] POST /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/action => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:37:45 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-20d89988-5101-4733-854c-fdfba5304165 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:37:45 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-1e53f403-25d6-4be1-9947-c74a54231ca9 req-9014dbda-d37c-4264-89eb-c06e1345cf0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e3d0956-d528-4097-a200-d9b2b6ce7aa8", "tag": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:37:45 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-20d89988-5101-4733-854c-fdfba5304165 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:37:45 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-20d89988-5101-4733-854c-fdfba5304165 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:45 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-20d89988-5101-4733-854c-fdfba5304165 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:45 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-20d89988-5101-4733-854c-fdfba5304165 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:45 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-20d89988-5101-4733-854c-fdfba5304165 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:45 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-1e53f403-25d6-4be1-9947-c74a54231ca9 req-9014dbda-d37c-4264-89eb-c06e1345cf0b service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:45 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-20d89988-5101-4733-854c-fdfba5304165 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:45 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-1e53f403-25d6-4be1-9947-c74a54231ca9 req-9014dbda-d37c-4264-89eb-c06e1345cf0b service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:45 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-20d89988-5101-4733-854c-fdfba5304165 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:45 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-1e53f403-25d6-4be1-9947-c74a54231ca9 req-9014dbda-d37c-4264-89eb-c06e1345cf0b service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:45 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-1e53f403-25d6-4be1-9947-c74a54231ca9 req-9014dbda-d37c-4264-89eb-c06e1345cf0b service nova] Creating event network-changed:19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 for instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 on user Apr 11 15:37:45 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-1e53f403-25d6-4be1-9947-c74a54231ca9 req-9014dbda-d37c-4264-89eb-c06e1345cf0b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030796 Apr 11 15:37:45 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 218/657] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:37:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:37:45 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-20d89988-5101-4733-854c-fdfba5304165 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044f17aee3324b3a97bebe935548b3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23461a3d7ca49f6a77d3fde6f1009d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:37:45 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-20d89988-5101-4733-854c-fdfba5304165 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8" status: 200 len: 1749 microversion: 2.1 time: 0.161026 Apr 11 15:37:45 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 218/658] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:37:45 2023] GET /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8 => generated 1749 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:37:46 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-cf1f5ee5-5314-46ea-a2c3-0171517d4864 req-f092c58b-77e4-4f26-b9d1-38cefc42ed9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "058df5ba-07ab-4bdd-9a47-907e7b0e0e59", "name": "network-vif-plugged", "status": "completed", "tag": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:37:46 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-cf1f5ee5-5314-46ea-a2c3-0171517d4864 req-f092c58b-77e4-4f26-b9d1-38cefc42ed9c service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:46 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-cf1f5ee5-5314-46ea-a2c3-0171517d4864 req-f092c58b-77e4-4f26-b9d1-38cefc42ed9c service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:46 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-cf1f5ee5-5314-46ea-a2c3-0171517d4864 req-f092c58b-77e4-4f26-b9d1-38cefc42ed9c service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:46 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:37:46 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-cf1f5ee5-5314-46ea-a2c3-0171517d4864 req-f092c58b-77e4-4f26-b9d1-38cefc42ed9c service nova] Creating event network-vif-plugged:cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 for instance 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 on user Apr 11 15:37:46 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-cf1f5ee5-5314-46ea-a2c3-0171517d4864 req-f092c58b-77e4-4f26-b9d1-38cefc42ed9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037608 Apr 11 15:37:46 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 223/659] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:37:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:37:46 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:37:46 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:37:46 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:46 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:46 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:46 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:46 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:46 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:46 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/action" status: 202 len: 0 microversion: 2.1 time: 0.091212 Apr 11 15:37:46 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 219/660] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 15:37:46 2023] POST /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:37:46 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-5ba3aa94-1d05-4ba1-8273-1a295b93cad3 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:37:46 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-5ba3aa94-1d05-4ba1-8273-1a295b93cad3 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:37:46 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5ba3aa94-1d05-4ba1-8273-1a295b93cad3 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:46 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5ba3aa94-1d05-4ba1-8273-1a295b93cad3 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:46 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5ba3aa94-1d05-4ba1-8273-1a295b93cad3 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:46 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5ba3aa94-1d05-4ba1-8273-1a295b93cad3 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:46 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5ba3aa94-1d05-4ba1-8273-1a295b93cad3 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:46 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5ba3aa94-1d05-4ba1-8273-1a295b93cad3 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:47 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-5ba3aa94-1d05-4ba1-8273-1a295b93cad3 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044f17aee3324b3a97bebe935548b3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23461a3d7ca49f6a77d3fde6f1009d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:37:47 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-5ba3aa94-1d05-4ba1-8273-1a295b93cad3 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8" status: 200 len: 1751 microversion: 2.1 time: 0.169339 Apr 11 15:37:47 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 219/661] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:37:46 2023] GET /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8 => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:37:47 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-24614ad6-62c5-4201-8d72-05bf798c4498 req-1bbf102c-9833-40a6-8c58-e6496b22a03b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e3d0956-d528-4097-a200-d9b2b6ce7aa8", "name": "network-vif-unplugged", "status": "completed", "tag": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:37:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-24614ad6-62c5-4201-8d72-05bf798c4498 req-1bbf102c-9833-40a6-8c58-e6496b22a03b service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-24614ad6-62c5-4201-8d72-05bf798c4498 req-1bbf102c-9833-40a6-8c58-e6496b22a03b service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-24614ad6-62c5-4201-8d72-05bf798c4498 req-1bbf102c-9833-40a6-8c58-e6496b22a03b service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:47 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-24614ad6-62c5-4201-8d72-05bf798c4498 req-1bbf102c-9833-40a6-8c58-e6496b22a03b service nova] Creating event network-vif-unplugged:19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 for instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 on user Apr 11 15:37:47 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-24614ad6-62c5-4201-8d72-05bf798c4498 req-1bbf102c-9833-40a6-8c58-e6496b22a03b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036848 Apr 11 15:37:47 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 224/662] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:37:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:37:48 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-24a4011d-2636-4e7f-ab1d-d323b539d7d2 req-5e95ac17-0c2e-4cb0-8bb8-f4f7fbdacf53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "058df5ba-07ab-4bdd-9a47-907e7b0e0e59", "name": "network-vif-plugged", "status": "completed", "tag": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4"}, {"server_uuid": "058df5ba-07ab-4bdd-9a47-907e7b0e0e59", "name": "network-vif-plugged", "status": "completed", "tag": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:37:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-24a4011d-2636-4e7f-ab1d-d323b539d7d2 req-5e95ac17-0c2e-4cb0-8bb8-f4f7fbdacf53 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-24a4011d-2636-4e7f-ab1d-d323b539d7d2 req-5e95ac17-0c2e-4cb0-8bb8-f4f7fbdacf53 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-24a4011d-2636-4e7f-ab1d-d323b539d7d2 req-5e95ac17-0c2e-4cb0-8bb8-f4f7fbdacf53 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:48 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-24a4011d-2636-4e7f-ab1d-d323b539d7d2 req-5e95ac17-0c2e-4cb0-8bb8-f4f7fbdacf53 service nova] Creating event network-vif-plugged:cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 for instance 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 on user Apr 11 15:37:48 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-24a4011d-2636-4e7f-ab1d-d323b539d7d2 req-5e95ac17-0c2e-4cb0-8bb8-f4f7fbdacf53 service nova] Creating event network-vif-plugged:cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 for instance 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 on user Apr 11 15:37:48 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-24a4011d-2636-4e7f-ab1d-d323b539d7d2 req-5e95ac17-0c2e-4cb0-8bb8-f4f7fbdacf53 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030812 Apr 11 15:37:48 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 220/663] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:37:48 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:37:49 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-c0eee073-be8b-4080-996c-09367b11e6f6 req-7738ad53-278b-479a-b609-f0ca903b980a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e3d0956-d528-4097-a200-d9b2b6ce7aa8", "name": "network-vif-plugged", "status": "completed", "tag": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:37:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-c0eee073-be8b-4080-996c-09367b11e6f6 req-7738ad53-278b-479a-b609-f0ca903b980a service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-c0eee073-be8b-4080-996c-09367b11e6f6 req-7738ad53-278b-479a-b609-f0ca903b980a service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-c0eee073-be8b-4080-996c-09367b11e6f6 req-7738ad53-278b-479a-b609-f0ca903b980a service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:49 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-c0eee073-be8b-4080-996c-09367b11e6f6 req-7738ad53-278b-479a-b609-f0ca903b980a service nova] Creating event network-vif-plugged:19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 for instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 on user Apr 11 15:37:49 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-c0eee073-be8b-4080-996c-09367b11e6f6 req-7738ad53-278b-479a-b609-f0ca903b980a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032034 Apr 11 15:37:49 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 220/664] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:37:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:37:51 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-85cb66e0-a108-427f-9bfe-998441fefeaf tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:37:51 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-85cb66e0-a108-427f-9bfe-998441fefeaf tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:37:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-85cb66e0-a108-427f-9bfe-998441fefeaf tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-85cb66e0-a108-427f-9bfe-998441fefeaf tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-85cb66e0-a108-427f-9bfe-998441fefeaf tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-85cb66e0-a108-427f-9bfe-998441fefeaf tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-85cb66e0-a108-427f-9bfe-998441fefeaf tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-85cb66e0-a108-427f-9bfe-998441fefeaf tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:51 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-85cb66e0-a108-427f-9bfe-998441fefeaf tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] HTTP exception thrown: Instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 could not be found. Apr 11 15:37:51 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-85cb66e0-a108-427f-9bfe-998441fefeaf tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Request method failure captured: Apr 11 15:37:51 user devstack@n-api.service[61167]: request: GET /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59 HTTP/1.1 Apr 11 15:37:51 user devstack@n-api.service[61167]: Accept: application/json Apr 11 15:37:51 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 15:37:51 user devstack@n-api.service[61167]: Connection: close Apr 11 15:37:51 user devstack@n-api.service[61167]: Content-Length: 0 Apr 11 15:37:51 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 15:37:51 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 15:37:51 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 15:37:51 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 15:37:51 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNXuRmukKFdyrff1cZpmSI5bUhJleAnLM1D6Veg4YggW5e9xf0q2Ms-3mHIpTMhRbxwJ-IsunSj7_ute5ZXoB-lKpxSwMLxkdEgp7mv1pZCD1_2C24WRu1XrtwW5HoEw3OUXrYDgD7os6ju5cll5jYJdSTBnwAsWwVbB4wJ4Gg83eo5w Apr 11 15:37:51 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 15:37:51 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 15:37:51 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 15:37:51 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 15:37:51 user devstack@n-api.service[61167]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 15:37:51 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 15:37:51 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 15:37:51 user devstack@n-api.service[61167]: X-Project-Id: 63b9b79fb98441fd9f1b5df54471f0bd Apr 11 15:37:51 user devstack@n-api.service[61167]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1785499036 Apr 11 15:37:51 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 15:37:51 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 15:37:51 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/63b9b79fb98441fd9f1b5df54471f0bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/63b9b79fb98441fd9f1b5df54471f0bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/63b9b79fb98441fd9f1b5df54471f0bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:37:51 user devstack@n-api.service[61167]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1785499036 Apr 11 15:37:51 user devstack@n-api.service[61167]: X-Tenant-Id: 63b9b79fb98441fd9f1b5df54471f0bd Apr 11 15:37:51 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1785499036 Apr 11 15:37:51 user devstack@n-api.service[61167]: X-User: tempest-AttachVolumeShelveTestJSON-1785499036-project-member Apr 11 15:37:51 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 15:37:51 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 15:37:51 user devstack@n-api.service[61167]: X-User-Id: 88d988d9ce0a41669b7c487ac07b4cfe Apr 11 15:37:51 user devstack@n-api.service[61167]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1785499036-project-member Apr 11 15:37:51 user devstack@n-api.service[61167]: method: > Apr 11 15:37:51 user devstack@n-api.service[61167]: exception: Instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 could not be found. Apr 11 15:37:51 user devstack@n-api.service[61167]: action_args: {'id': 'ffc25fc1-e59f-42c8-a371-b4b12e17fd59'} Apr 11 15:37:51 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 could not be found. Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 could not be found. Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 could not be found. Apr 11 15:37:51 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:37:51 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-85cb66e0-a108-427f-9bfe-998441fefeaf tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Returning 404 to user: Instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 could not be found. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:37:51 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-85cb66e0-a108-427f-9bfe-998441fefeaf tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59" status: 404 len: 111 microversion: 2.20 time: 0.033147 Apr 11 15:37:51 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 225/665] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:37:51 2023] GET /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 15:37:51 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-adbb6155-c447-4cd3-b910-c5ca0a67e9de tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '.version_select at 0x7f4c2ec691b0>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:37:51 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-adbb6155-c447-4cd3-b910-c5ca0a67e9de tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1917410281" status: 204 len: 0 microversion: 2.20 time: 0.022138 Apr 11 15:37:51 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 221/666] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Apr 11 15:37:51 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1917410281 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 15:37:53 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-4fd4365d-b689-4796-9050-00f2686fa59f tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:37:53 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-4fd4365d-b689-4796-9050-00f2686fa59f tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:37:53 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4fd4365d-b689-4796-9050-00f2686fa59f tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:53 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4fd4365d-b689-4796-9050-00f2686fa59f tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:53 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4fd4365d-b689-4796-9050-00f2686fa59f tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:53 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4fd4365d-b689-4796-9050-00f2686fa59f tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:53 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4fd4365d-b689-4796-9050-00f2686fa59f tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:53 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4fd4365d-b689-4796-9050-00f2686fa59f tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:53 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-4fd4365d-b689-4796-9050-00f2686fa59f tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] HTTP exception thrown: Instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 could not be found. Apr 11 15:37:53 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-4fd4365d-b689-4796-9050-00f2686fa59f tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Request method failure captured: Apr 11 15:37:53 user devstack@n-api.service[61165]: request: DELETE /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59 HTTP/1.1 Apr 11 15:37:53 user devstack@n-api.service[61165]: Accept: application/json Apr 11 15:37:53 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 15:37:53 user devstack@n-api.service[61165]: Connection: close Apr 11 15:37:53 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 15:37:53 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 15:37:53 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 15:37:53 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 15:37:53 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 15:37:53 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNXuRmukKFdyrff1cZpmSI5bUhJleAnLM1D6Veg4YggW5e9xf0q2Ms-3mHIpTMhRbxwJ-IsunSj7_ute5ZXoB-lKpxSwMLxkdEgp7mv1pZCD1_2C24WRu1XrtwW5HoEw3OUXrYDgD7os6ju5cll5jYJdSTBnwAsWwVbB4wJ4Gg83eo5w Apr 11 15:37:53 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 15:37:53 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 15:37:53 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 15:37:53 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 15:37:53 user devstack@n-api.service[61165]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 15:37:53 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 15:37:53 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 15:37:53 user devstack@n-api.service[61165]: X-Project-Id: 63b9b79fb98441fd9f1b5df54471f0bd Apr 11 15:37:53 user devstack@n-api.service[61165]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1785499036 Apr 11 15:37:53 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 15:37:53 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 15:37:53 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/63b9b79fb98441fd9f1b5df54471f0bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/63b9b79fb98441fd9f1b5df54471f0bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/63b9b79fb98441fd9f1b5df54471f0bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:37:53 user devstack@n-api.service[61165]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1785499036 Apr 11 15:37:53 user devstack@n-api.service[61165]: X-Tenant-Id: 63b9b79fb98441fd9f1b5df54471f0bd Apr 11 15:37:53 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1785499036 Apr 11 15:37:53 user devstack@n-api.service[61165]: X-User: tempest-AttachVolumeShelveTestJSON-1785499036-project-member Apr 11 15:37:53 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 15:37:53 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 15:37:53 user devstack@n-api.service[61165]: X-User-Id: 88d988d9ce0a41669b7c487ac07b4cfe Apr 11 15:37:53 user devstack@n-api.service[61165]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1785499036-project-member Apr 11 15:37:53 user devstack@n-api.service[61165]: method: > Apr 11 15:37:53 user devstack@n-api.service[61165]: exception: Instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 could not be found. Apr 11 15:37:53 user devstack@n-api.service[61165]: action_args: {'id': 'ffc25fc1-e59f-42c8-a371-b4b12e17fd59'} Apr 11 15:37:53 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 could not be found. Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 could not be found. Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 could not be found. Apr 11 15:37:53 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:37:53 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-4fd4365d-b689-4796-9050-00f2686fa59f tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Returning 404 to user: Instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:37:53 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-4fd4365d-b689-4796-9050-00f2686fa59f tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59" status: 404 len: 111 microversion: 2.20 time: 0.034644 Apr 11 15:37:53 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 221/667] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 15:37:53 2023] DELETE /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 11 15:37:53 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-19f8f69b-c883-4eef-9884-60413e41cb22 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:37:53 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-19f8f69b-c883-4eef-9884-60413e41cb22 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:37:53 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-d5a4930f-8345-42e4-9c0c-afe3894ccd43 req-291fe1ed-0058-4172-b8b1-89a8c4c72ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e3d0956-d528-4097-a200-d9b2b6ce7aa8", "name": "network-vif-plugged", "status": "completed", "tag": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:37:53 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-19f8f69b-c883-4eef-9884-60413e41cb22 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:53 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-19f8f69b-c883-4eef-9884-60413e41cb22 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:53 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-19f8f69b-c883-4eef-9884-60413e41cb22 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:53 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-19f8f69b-c883-4eef-9884-60413e41cb22 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:53 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-19f8f69b-c883-4eef-9884-60413e41cb22 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:53 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-19f8f69b-c883-4eef-9884-60413e41cb22 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:53 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-d5a4930f-8345-42e4-9c0c-afe3894ccd43 req-291fe1ed-0058-4172-b8b1-89a8c4c72ef1 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:53 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-d5a4930f-8345-42e4-9c0c-afe3894ccd43 req-291fe1ed-0058-4172-b8b1-89a8c4c72ef1 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:53 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-d5a4930f-8345-42e4-9c0c-afe3894ccd43 req-291fe1ed-0058-4172-b8b1-89a8c4c72ef1 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:53 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-19f8f69b-c883-4eef-9884-60413e41cb22 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] HTTP exception thrown: Instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 could not be found. Apr 11 15:37:53 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-19f8f69b-c883-4eef-9884-60413e41cb22 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Request method failure captured: Apr 11 15:37:53 user devstack@n-api.service[61167]: request: GET /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59 HTTP/1.1 Apr 11 15:37:53 user devstack@n-api.service[61167]: Accept: application/json Apr 11 15:37:53 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 15:37:53 user devstack@n-api.service[61167]: Connection: close Apr 11 15:37:53 user devstack@n-api.service[61167]: Content-Length: 0 Apr 11 15:37:53 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 15:37:53 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 15:37:53 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 15:37:53 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 15:37:53 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNXuRmukKFdyrff1cZpmSI5bUhJleAnLM1D6Veg4YggW5e9xf0q2Ms-3mHIpTMhRbxwJ-IsunSj7_ute5ZXoB-lKpxSwMLxkdEgp7mv1pZCD1_2C24WRu1XrtwW5HoEw3OUXrYDgD7os6ju5cll5jYJdSTBnwAsWwVbB4wJ4Gg83eo5w Apr 11 15:37:53 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 15:37:53 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 15:37:53 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 15:37:53 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 15:37:53 user devstack@n-api.service[61167]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 15:37:53 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 15:37:53 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 15:37:53 user devstack@n-api.service[61167]: X-Project-Id: 63b9b79fb98441fd9f1b5df54471f0bd Apr 11 15:37:53 user devstack@n-api.service[61167]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1785499036 Apr 11 15:37:53 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 15:37:53 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 15:37:53 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/63b9b79fb98441fd9f1b5df54471f0bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/63b9b79fb98441fd9f1b5df54471f0bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/63b9b79fb98441fd9f1b5df54471f0bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:37:53 user devstack@n-api.service[61167]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1785499036 Apr 11 15:37:53 user devstack@n-api.service[61167]: X-Tenant-Id: 63b9b79fb98441fd9f1b5df54471f0bd Apr 11 15:37:53 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1785499036 Apr 11 15:37:53 user devstack@n-api.service[61167]: X-User: tempest-AttachVolumeShelveTestJSON-1785499036-project-member Apr 11 15:37:53 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 15:37:53 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 15:37:53 user devstack@n-api.service[61167]: X-User-Id: 88d988d9ce0a41669b7c487ac07b4cfe Apr 11 15:37:53 user devstack@n-api.service[61167]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1785499036-project-member Apr 11 15:37:53 user devstack@n-api.service[61167]: method: > Apr 11 15:37:53 user devstack@n-api.service[61167]: exception: Instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 could not be found. Apr 11 15:37:53 user devstack@n-api.service[61167]: action_args: {'id': 'ffc25fc1-e59f-42c8-a371-b4b12e17fd59'} Apr 11 15:37:53 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 could not be found. Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 could not be found. Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 could not be found. Apr 11 15:37:53 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:37:53 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-19f8f69b-c883-4eef-9884-60413e41cb22 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Returning 404 to user: Instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 could not be found. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:37:53 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-19f8f69b-c883-4eef-9884-60413e41cb22 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59" status: 404 len: 111 microversion: 2.20 time: 0.044010 Apr 11 15:37:53 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 226/668] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:37:53 2023] GET /compute/v2.1/servers/ffc25fc1-e59f-42c8-a371-b4b12e17fd59 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 15:37:53 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-d5a4930f-8345-42e4-9c0c-afe3894ccd43 req-291fe1ed-0058-4172-b8b1-89a8c4c72ef1 service nova] Creating event network-vif-plugged:19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 for instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 on user Apr 11 15:37:53 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-d5a4930f-8345-42e4-9c0c-afe3894ccd43 req-291fe1ed-0058-4172-b8b1-89a8c4c72ef1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057198 Apr 11 15:37:53 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 222/669] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:37:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:37:54 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-5c24372b-79d9-4816-9913-861ded26b419 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:37:54 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-5c24372b-79d9-4816-9913-861ded26b419 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:37:54 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5c24372b-79d9-4816-9913-861ded26b419 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:54 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5c24372b-79d9-4816-9913-861ded26b419 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:54 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5c24372b-79d9-4816-9913-861ded26b419 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:54 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5c24372b-79d9-4816-9913-861ded26b419 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:54 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5c24372b-79d9-4816-9913-861ded26b419 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:54 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5c24372b-79d9-4816-9913-861ded26b419 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:54 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-5c24372b-79d9-4816-9913-861ded26b419 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] HTTP exception thrown: Instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d could not be found. Apr 11 15:37:54 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-5c24372b-79d9-4816-9913-861ded26b419 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Request method failure captured: Apr 11 15:37:54 user devstack@n-api.service[61165]: request: DELETE /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d HTTP/1.1 Apr 11 15:37:54 user devstack@n-api.service[61165]: Accept: application/json Apr 11 15:37:54 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 15:37:54 user devstack@n-api.service[61165]: Connection: close Apr 11 15:37:54 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 15:37:54 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 15:37:54 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 15:37:54 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 15:37:54 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 15:37:54 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNXuRmukKFdyrff1cZpmSI5bUhJleAnLM1D6Veg4YggW5e9xf0q2Ms-3mHIpTMhRbxwJ-IsunSj7_ute5ZXoB-lKpxSwMLxkdEgp7mv1pZCD1_2C24WRu1XrtwW5HoEw3OUXrYDgD7os6ju5cll5jYJdSTBnwAsWwVbB4wJ4Gg83eo5w Apr 11 15:37:54 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 15:37:54 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 15:37:54 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 15:37:54 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 15:37:54 user devstack@n-api.service[61165]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 15:37:54 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 15:37:54 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 15:37:54 user devstack@n-api.service[61165]: X-Project-Id: 63b9b79fb98441fd9f1b5df54471f0bd Apr 11 15:37:54 user devstack@n-api.service[61165]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1785499036 Apr 11 15:37:54 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 15:37:54 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 15:37:54 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/63b9b79fb98441fd9f1b5df54471f0bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/63b9b79fb98441fd9f1b5df54471f0bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/63b9b79fb98441fd9f1b5df54471f0bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:37:54 user devstack@n-api.service[61165]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1785499036 Apr 11 15:37:54 user devstack@n-api.service[61165]: X-Tenant-Id: 63b9b79fb98441fd9f1b5df54471f0bd Apr 11 15:37:54 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1785499036 Apr 11 15:37:54 user devstack@n-api.service[61165]: X-User: tempest-AttachVolumeShelveTestJSON-1785499036-project-member Apr 11 15:37:54 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 15:37:54 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 15:37:54 user devstack@n-api.service[61165]: X-User-Id: 88d988d9ce0a41669b7c487ac07b4cfe Apr 11 15:37:54 user devstack@n-api.service[61165]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1785499036-project-member Apr 11 15:37:54 user devstack@n-api.service[61165]: method: > Apr 11 15:37:54 user devstack@n-api.service[61165]: exception: Instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d could not be found. Apr 11 15:37:54 user devstack@n-api.service[61165]: action_args: {'id': '1e01618b-2aa4-4b56-b1a2-0d6e25e3075d'} Apr 11 15:37:54 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d could not be found. Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d could not be found. Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d could not be found. Apr 11 15:37:54 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:37:54 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-5c24372b-79d9-4816-9913-861ded26b419 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Returning 404 to user: Instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:37:54 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-5c24372b-79d9-4816-9913-861ded26b419 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" status: 404 len: 111 microversion: 2.20 time: 0.036365 Apr 11 15:37:54 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 222/670] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 15:37:54 2023] DELETE /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 15:37:54 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-426df7a4-d77c-4ba0-8cdc-a5d381d1a73d tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:37:54 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-426df7a4-d77c-4ba0-8cdc-a5d381d1a73d tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:37:54 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-426df7a4-d77c-4ba0-8cdc-a5d381d1a73d tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:54 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-426df7a4-d77c-4ba0-8cdc-a5d381d1a73d tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:54 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-426df7a4-d77c-4ba0-8cdc-a5d381d1a73d tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:54 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-426df7a4-d77c-4ba0-8cdc-a5d381d1a73d tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:54 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-426df7a4-d77c-4ba0-8cdc-a5d381d1a73d tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:54 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-426df7a4-d77c-4ba0-8cdc-a5d381d1a73d tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:54 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-426df7a4-d77c-4ba0-8cdc-a5d381d1a73d tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] HTTP exception thrown: Instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d could not be found. Apr 11 15:37:54 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-426df7a4-d77c-4ba0-8cdc-a5d381d1a73d tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Request method failure captured: Apr 11 15:37:54 user devstack@n-api.service[61167]: request: GET /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d HTTP/1.1 Apr 11 15:37:54 user devstack@n-api.service[61167]: Accept: application/json Apr 11 15:37:54 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 15:37:54 user devstack@n-api.service[61167]: Connection: close Apr 11 15:37:54 user devstack@n-api.service[61167]: Content-Length: 0 Apr 11 15:37:54 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 15:37:54 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 15:37:54 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 15:37:54 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 15:37:54 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNXuRmukKFdyrff1cZpmSI5bUhJleAnLM1D6Veg4YggW5e9xf0q2Ms-3mHIpTMhRbxwJ-IsunSj7_ute5ZXoB-lKpxSwMLxkdEgp7mv1pZCD1_2C24WRu1XrtwW5HoEw3OUXrYDgD7os6ju5cll5jYJdSTBnwAsWwVbB4wJ4Gg83eo5w Apr 11 15:37:54 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 15:37:54 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 15:37:54 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 15:37:54 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 15:37:54 user devstack@n-api.service[61167]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 15:37:54 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 15:37:54 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 15:37:54 user devstack@n-api.service[61167]: X-Project-Id: 63b9b79fb98441fd9f1b5df54471f0bd Apr 11 15:37:54 user devstack@n-api.service[61167]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1785499036 Apr 11 15:37:54 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 15:37:54 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 15:37:54 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/63b9b79fb98441fd9f1b5df54471f0bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/63b9b79fb98441fd9f1b5df54471f0bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/63b9b79fb98441fd9f1b5df54471f0bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:37:54 user devstack@n-api.service[61167]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1785499036 Apr 11 15:37:54 user devstack@n-api.service[61167]: X-Tenant-Id: 63b9b79fb98441fd9f1b5df54471f0bd Apr 11 15:37:54 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1785499036 Apr 11 15:37:54 user devstack@n-api.service[61167]: X-User: tempest-AttachVolumeShelveTestJSON-1785499036-project-member Apr 11 15:37:54 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 15:37:54 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 15:37:54 user devstack@n-api.service[61167]: X-User-Id: 88d988d9ce0a41669b7c487ac07b4cfe Apr 11 15:37:54 user devstack@n-api.service[61167]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1785499036-project-member Apr 11 15:37:54 user devstack@n-api.service[61167]: method: > Apr 11 15:37:54 user devstack@n-api.service[61167]: exception: Instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d could not be found. Apr 11 15:37:54 user devstack@n-api.service[61167]: action_args: {'id': '1e01618b-2aa4-4b56-b1a2-0d6e25e3075d'} Apr 11 15:37:54 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d could not be found. Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d could not be found. Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d could not be found. Apr 11 15:37:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:37:54 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-426df7a4-d77c-4ba0-8cdc-a5d381d1a73d tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Returning 404 to user: Instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d could not be found. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:37:54 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-426df7a4-d77c-4ba0-8cdc-a5d381d1a73d tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" status: 404 len: 111 microversion: 2.20 time: 0.030758 Apr 11 15:37:54 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 227/671] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:37:54 2023] GET /compute/v2.1/servers/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 15:37:55 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-194cfd06-ef0d-47f6-9a3a-f56ec0a262f2 req-3a6c09fc-ecc8-4286-9be6-c359ed87ed7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e3d0956-d528-4097-a200-d9b2b6ce7aa8", "name": "network-vif-plugged", "status": "completed", "tag": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:37:55 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-194cfd06-ef0d-47f6-9a3a-f56ec0a262f2 req-3a6c09fc-ecc8-4286-9be6-c359ed87ed7b service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:55 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-194cfd06-ef0d-47f6-9a3a-f56ec0a262f2 req-3a6c09fc-ecc8-4286-9be6-c359ed87ed7b service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:55 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-194cfd06-ef0d-47f6-9a3a-f56ec0a262f2 req-3a6c09fc-ecc8-4286-9be6-c359ed87ed7b service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:55 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-194cfd06-ef0d-47f6-9a3a-f56ec0a262f2 req-3a6c09fc-ecc8-4286-9be6-c359ed87ed7b service nova] Creating event network-vif-plugged:19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 for instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 on user Apr 11 15:37:55 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-194cfd06-ef0d-47f6-9a3a-f56ec0a262f2 req-3a6c09fc-ecc8-4286-9be6-c359ed87ed7b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031540 Apr 11 15:37:55 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 223/672] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:37:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:37:58 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:37:58 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:37:58 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:58 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:58 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:58 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:58 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:58 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:58 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:37:58 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Going to try to terminate instance {{(pid=61165) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:37:58 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d09cda86-eca1-4c42-8654-758eb6cd30e0" status: 204 len: 0 microversion: 2.87 time: 0.504356 Apr 11 15:37:58 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 223/673] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 15:37:58 2023] DELETE /compute/v2.1/servers/d09cda86-eca1-4c42-8654-758eb6cd30e0 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 15:37:58 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-8ec6cfda-f599-4692-a840-784fd3d5a71b tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:37:58 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-8ec6cfda-f599-4692-a840-784fd3d5a71b tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:37:58 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8ec6cfda-f599-4692-a840-784fd3d5a71b tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:58 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8ec6cfda-f599-4692-a840-784fd3d5a71b tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:58 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8ec6cfda-f599-4692-a840-784fd3d5a71b tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:58 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8ec6cfda-f599-4692-a840-784fd3d5a71b tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:58 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8ec6cfda-f599-4692-a840-784fd3d5a71b tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:58 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8ec6cfda-f599-4692-a840-784fd3d5a71b tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:59 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-8ec6cfda-f599-4692-a840-784fd3d5a71b tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:37:59 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-8ec6cfda-f599-4692-a840-784fd3d5a71b tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:37:59 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-8ec6cfda-f599-4692-a840-784fd3d5a71b tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:37:59 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-8ec6cfda-f599-4692-a840-784fd3d5a71b tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d09cda86-eca1-4c42-8654-758eb6cd30e0" status: 200 len: 1773 microversion: 2.87 time: 0.237497 Apr 11 15:37:59 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 228/674] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:37:58 2023] GET /compute/v2.1/servers/d09cda86-eca1-4c42-8654-758eb6cd30e0 => generated 1773 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:37:59 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-4457b64c-6bed-4f7a-b3c9-2bcfa1f004c0 req-43f5db9a-756d-49c2-a87e-90e9bda32ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09cda86-eca1-4c42-8654-758eb6cd30e0", "name": "network-vif-unplugged", "status": "completed", "tag": "27d62f09-c938-4a71-be1e-6dc1d6a47382"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:37:59 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-4457b64c-6bed-4f7a-b3c9-2bcfa1f004c0 req-43f5db9a-756d-49c2-a87e-90e9bda32ff3 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:37:59 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-4457b64c-6bed-4f7a-b3c9-2bcfa1f004c0 req-43f5db9a-756d-49c2-a87e-90e9bda32ff3 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:37:59 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-4457b64c-6bed-4f7a-b3c9-2bcfa1f004c0 req-43f5db9a-756d-49c2-a87e-90e9bda32ff3 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:37:59 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-4457b64c-6bed-4f7a-b3c9-2bcfa1f004c0 req-43f5db9a-756d-49c2-a87e-90e9bda32ff3 service nova] Creating event network-vif-unplugged:27d62f09-c938-4a71-be1e-6dc1d6a47382 for instance d09cda86-eca1-4c42-8654-758eb6cd30e0 on user Apr 11 15:37:59 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-4457b64c-6bed-4f7a-b3c9-2bcfa1f004c0 req-43f5db9a-756d-49c2-a87e-90e9bda32ff3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046018 Apr 11 15:37:59 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 224/675] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:37:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:38:01 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09cda86-eca1-4c42-8654-758eb6cd30e0", "name": "network-vif-plugged", "status": "completed", "tag": "27d62f09-c938-4a71-be1e-6dc1d6a47382"}, {"server_uuid": "d09cda86-eca1-4c42-8654-758eb6cd30e0", "name": "network-vif-plugged", "status": "completed", "tag": "27d62f09-c938-4a71-be1e-6dc1d6a47382"}, {"server_uuid": "d09cda86-eca1-4c42-8654-758eb6cd30e0", "name": "network-vif-plugged", "status": "completed", "tag": "27d62f09-c938-4a71-be1e-6dc1d6a47382"}, {"server_uuid": "d09cda86-eca1-4c42-8654-758eb6cd30e0", "name": "network-vif-plugged", "status": "completed", "tag": "27d62f09-c938-4a71-be1e-6dc1d6a47382"}, {"server_uuid": "d09cda86-eca1-4c42-8654-758eb6cd30e0", "name": "network-vif-deleted", "tag": "27d62f09-c938-4a71-be1e-6dc1d6a47382"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:38:01 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:38:01 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:38:01 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:38:01 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] Creating event network-vif-plugged:27d62f09-c938-4a71-be1e-6dc1d6a47382 for instance d09cda86-eca1-4c42-8654-758eb6cd30e0 on user Apr 11 15:38:01 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] Creating event network-vif-plugged:27d62f09-c938-4a71-be1e-6dc1d6a47382 for instance d09cda86-eca1-4c42-8654-758eb6cd30e0 on user Apr 11 15:38:01 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] Creating event network-vif-plugged:27d62f09-c938-4a71-be1e-6dc1d6a47382 for instance d09cda86-eca1-4c42-8654-758eb6cd30e0 on user Apr 11 15:38:01 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] Creating event network-vif-plugged:27d62f09-c938-4a71-be1e-6dc1d6a47382 for instance d09cda86-eca1-4c42-8654-758eb6cd30e0 on user Apr 11 15:38:01 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] Creating event network-vif-deleted:27d62f09-c938-4a71-be1e-6dc1d6a47382 for instance d09cda86-eca1-4c42-8654-758eb6cd30e0 on user Apr 11 15:38:01 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.034580 Apr 11 15:38:01 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 224/676] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:38:01 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:38:08 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-b82743de-a144-4959-b01a-72d4bc07ab19 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:38:08 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-b82743de-a144-4959-b01a-72d4bc07ab19 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:38:08 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b82743de-a144-4959-b01a-72d4bc07ab19 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:38:08 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b82743de-a144-4959-b01a-72d4bc07ab19 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:38:08 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b82743de-a144-4959-b01a-72d4bc07ab19 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:38:08 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b82743de-a144-4959-b01a-72d4bc07ab19 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:38:08 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b82743de-a144-4959-b01a-72d4bc07ab19 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:38:08 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b82743de-a144-4959-b01a-72d4bc07ab19 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:38:08 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-b82743de-a144-4959-b01a-72d4bc07ab19 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:38:08 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-b82743de-a144-4959-b01a-72d4bc07ab19 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4" status: 200 len: 1427 microversion: 2.1 time: 0.491112 Apr 11 15:38:08 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 229/677] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:38:08 2023] GET /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4 => generated 1427 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:38:15 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:38:15 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:38:15 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-c0614754-2d65-40f8-b7a5-fc9931349e87 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:38:15 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-c0614754-2d65-40f8-b7a5-fc9931349e87 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:38:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c0614754-2d65-40f8-b7a5-fc9931349e87 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:38:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c0614754-2d65-40f8-b7a5-fc9931349e87 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:38:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c0614754-2d65-40f8-b7a5-fc9931349e87 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:38:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c0614754-2d65-40f8-b7a5-fc9931349e87 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:38:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c0614754-2d65-40f8-b7a5-fc9931349e87 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:38:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c0614754-2d65-40f8-b7a5-fc9931349e87 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:38:15 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-c0614754-2d65-40f8-b7a5-fc9931349e87 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] HTTP exception thrown: Instance f34c2249-840e-4475-87e6-648d173bc7ed could not be found. Apr 11 15:38:15 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-c0614754-2d65-40f8-b7a5-fc9931349e87 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Request method failure captured: Apr 11 15:38:15 user devstack@n-api.service[61166]: request: GET /compute/v2.1/servers/f34c2249-840e-4475-87e6-648d173bc7ed HTTP/1.1 Apr 11 15:38:15 user devstack@n-api.service[61166]: Accept: application/json Apr 11 15:38:15 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 15:38:15 user devstack@n-api.service[61166]: Connection: close Apr 11 15:38:15 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 15:38:15 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 15:38:15 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 15:38:15 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 15:38:15 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 15:38:15 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNX1J4AnrkqS0vi1kz5FsIapyiY_WastCT9YjOnhKxBWfpJGOOYFN188KiZdSMNxZKf5bXRske_YVpiDKkyudxMuI3xLYkawFSOK5Fqq2V2-deJT30SwtY9vjpiJV8kl-Y7G58eORL2apgqSmaKfZEzu_21xv4BO0fX0kr_uYhUSI_iQ Apr 11 15:38:15 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 15:38:15 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 15:38:15 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 15:38:15 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 15:38:15 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 15:38:15 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 15:38:15 user devstack@n-api.service[61166]: X-Project-Id: f0f7abe5e3144c7ab354ffaba1748616 Apr 11 15:38:15 user devstack@n-api.service[61166]: X-Project-Name: tempest-TestStampPattern-344874523 Apr 11 15:38:15 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 15:38:15 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 15:38:15 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0f7abe5e3144c7ab354ffaba1748616"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f0f7abe5e3144c7ab354ffaba1748616"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0f7abe5e3144c7ab354ffaba1748616"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:38:15 user devstack@n-api.service[61166]: X-Tenant: tempest-TestStampPattern-344874523 Apr 11 15:38:15 user devstack@n-api.service[61166]: X-Tenant-Id: f0f7abe5e3144c7ab354ffaba1748616 Apr 11 15:38:15 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-TestStampPattern-344874523 Apr 11 15:38:15 user devstack@n-api.service[61166]: X-User: tempest-TestStampPattern-344874523-project-member Apr 11 15:38:15 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 15:38:15 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 15:38:15 user devstack@n-api.service[61166]: X-User-Id: 402ec212c8a64a559f82c166070a92ef Apr 11 15:38:15 user devstack@n-api.service[61166]: X-User-Name: tempest-TestStampPattern-344874523-project-member Apr 11 15:38:15 user devstack@n-api.service[61166]: method: > Apr 11 15:38:15 user devstack@n-api.service[61166]: exception: Instance f34c2249-840e-4475-87e6-648d173bc7ed could not be found. Apr 11 15:38:15 user devstack@n-api.service[61166]: action_args: {'id': 'f34c2249-840e-4475-87e6-648d173bc7ed'} Apr 11 15:38:15 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f34c2249-840e-4475-87e6-648d173bc7ed could not be found. Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f34c2249-840e-4475-87e6-648d173bc7ed could not be found. Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f34c2249-840e-4475-87e6-648d173bc7ed could not be found. Apr 11 15:38:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:38:15 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-c0614754-2d65-40f8-b7a5-fc9931349e87 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Returning 404 to user: Instance f34c2249-840e-4475-87e6-648d173bc7ed could not be found. {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:38:15 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-c0614754-2d65-40f8-b7a5-fc9931349e87 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f34c2249-840e-4475-87e6-648d173bc7ed" status: 404 len: 111 microversion: 2.1 time: 0.040660 Apr 11 15:38:15 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 225/678] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:38:15 2023] GET /compute/v2.1/servers/f34c2249-840e-4475-87e6-648d173bc7ed => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:38:17 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:38:17 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:38:17 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-9ca04819-08f6-4de3-9a67-3f690c1e1d58 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:38:17 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-9ca04819-08f6-4de3-9a67-3f690c1e1d58 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:38:17 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-9ca04819-08f6-4de3-9a67-3f690c1e1d58 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:38:17 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-9ca04819-08f6-4de3-9a67-3f690c1e1d58 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:38:17 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-9ca04819-08f6-4de3-9a67-3f690c1e1d58 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:38:17 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-9ca04819-08f6-4de3-9a67-3f690c1e1d58 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:38:17 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-9ca04819-08f6-4de3-9a67-3f690c1e1d58 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:38:17 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-9ca04819-08f6-4de3-9a67-3f690c1e1d58 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:38:17 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-9ca04819-08f6-4de3-9a67-3f690c1e1d58 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] HTTP exception thrown: Instance 85658a44-9ff2-4553-b9fd-686bf35fd6ec is not attached to volume 5975605f-731a-43b1-8fef-2c0b05624d1a Apr 11 15:38:17 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-9ca04819-08f6-4de3-9a67-3f690c1e1d58 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Request method failure captured: Apr 11 15:38:17 user devstack@n-api.service[61165]: request: DELETE /compute/v2.1/servers/85658a44-9ff2-4553-b9fd-686bf35fd6ec/os-volume_attachments/5975605f-731a-43b1-8fef-2c0b05624d1a HTTP/1.1 Apr 11 15:38:17 user devstack@n-api.service[61165]: Accept: application/json Apr 11 15:38:17 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 15:38:17 user devstack@n-api.service[61165]: Connection: close Apr 11 15:38:17 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 15:38:17 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 15:38:17 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 15:38:17 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 15:38:17 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 15:38:17 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNX1J4AnrkqS0vi1kz5FsIapyiY_WastCT9YjOnhKxBWfpJGOOYFN188KiZdSMNxZKf5bXRske_YVpiDKkyudxMuI3xLYkawFSOK5Fqq2V2-deJT30SwtY9vjpiJV8kl-Y7G58eORL2apgqSmaKfZEzu_21xv4BO0fX0kr_uYhUSI_iQ Apr 11 15:38:17 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 15:38:17 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 15:38:17 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 15:38:17 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 15:38:17 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 15:38:17 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 15:38:17 user devstack@n-api.service[61165]: X-Project-Id: f0f7abe5e3144c7ab354ffaba1748616 Apr 11 15:38:17 user devstack@n-api.service[61165]: X-Project-Name: tempest-TestStampPattern-344874523 Apr 11 15:38:17 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 15:38:17 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 15:38:17 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0f7abe5e3144c7ab354ffaba1748616"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f0f7abe5e3144c7ab354ffaba1748616"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0f7abe5e3144c7ab354ffaba1748616"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:38:17 user devstack@n-api.service[61165]: X-Tenant: tempest-TestStampPattern-344874523 Apr 11 15:38:17 user devstack@n-api.service[61165]: X-Tenant-Id: f0f7abe5e3144c7ab354ffaba1748616 Apr 11 15:38:17 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-TestStampPattern-344874523 Apr 11 15:38:17 user devstack@n-api.service[61165]: X-User: tempest-TestStampPattern-344874523-project-member Apr 11 15:38:17 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 15:38:17 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 15:38:17 user devstack@n-api.service[61165]: X-User-Id: 402ec212c8a64a559f82c166070a92ef Apr 11 15:38:17 user devstack@n-api.service[61165]: X-User-Name: tempest-TestStampPattern-344874523-project-member Apr 11 15:38:17 user devstack@n-api.service[61165]: method: > Apr 11 15:38:17 user devstack@n-api.service[61165]: exception: Instance 85658a44-9ff2-4553-b9fd-686bf35fd6ec is not attached to volume 5975605f-731a-43b1-8fef-2c0b05624d1a Apr 11 15:38:17 user devstack@n-api.service[61165]: action_args: {'server_id': '85658a44-9ff2-4553-b9fd-686bf35fd6ec', 'id': '5975605f-731a-43b1-8fef-2c0b05624d1a'} Apr 11 15:38:17 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:38:17 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:38:17 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 11 15:38:17 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 11 15:38:17 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 11 15:38:17 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 11 15:38:17 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 11 15:38:17 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 11 15:38:17 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5975605f-731a-43b1-8fef-2c0b05624d1a. Apr 11 15:38:17 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:38:17 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:38:17 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:38:17 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:38:17 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:38:17 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:38:17 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:38:17 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:38:17 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:38:17 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:38:17 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 11 15:38:17 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 11 15:38:17 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85658a44-9ff2-4553-b9fd-686bf35fd6ec is not attached to volume 5975605f-731a-43b1-8fef-2c0b05624d1a Apr 11 15:38:17 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:38:17 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:38:17 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:38:17 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:38:17 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:38:17 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:38:17 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:38:17 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:38:17 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85658a44-9ff2-4553-b9fd-686bf35fd6ec is not attached to volume 5975605f-731a-43b1-8fef-2c0b05624d1a Apr 11 15:38:17 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:38:17 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-9ca04819-08f6-4de3-9a67-3f690c1e1d58 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Returning 404 to user: Instance 85658a44-9ff2-4553-b9fd-686bf35fd6ec is not attached to volume 5975605f-731a-43b1-8fef-2c0b05624d1a {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:38:17 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-9ca04819-08f6-4de3-9a67-3f690c1e1d58 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/85658a44-9ff2-4553-b9fd-686bf35fd6ec/os-volume_attachments/5975605f-731a-43b1-8fef-2c0b05624d1a" status: 404 len: 154 microversion: 2.1 time: 0.107254 Apr 11 15:38:17 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 225/679] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 15:38:17 2023] DELETE /compute/v2.1/servers/85658a44-9ff2-4553-b9fd-686bf35fd6ec/os-volume_attachments/5975605f-731a-43b1-8fef-2c0b05624d1a => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:38:18 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:38:18 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:38:18 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-8bef57d3-7cde-45f1-ada2-a6e77dc91965 req-0a6c9d63-f9fa-4bbf-845b-2f292e71a154 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85658a44-9ff2-4553-b9fd-686bf35fd6ec", "tag": "c6826c01-eadd-49db-a842-accd25f7534a"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:38:18 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=20 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:38:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:38:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:38:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:38:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:38:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:38:18 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-8bef57d3-7cde-45f1-ada2-a6e77dc91965 req-0a6c9d63-f9fa-4bbf-845b-2f292e71a154 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:38:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:38:18 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-8bef57d3-7cde-45f1-ada2-a6e77dc91965 req-0a6c9d63-f9fa-4bbf-845b-2f292e71a154 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:38:18 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-8bef57d3-7cde-45f1-ada2-a6e77dc91965 req-0a6c9d63-f9fa-4bbf-845b-2f292e71a154 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:38:18 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=22 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:38:18 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-8bef57d3-7cde-45f1-ada2-a6e77dc91965 req-0a6c9d63-f9fa-4bbf-845b-2f292e71a154 service nova] Creating event network-changed:c6826c01-eadd-49db-a842-accd25f7534a for instance 85658a44-9ff2-4553-b9fd-686bf35fd6ec on user Apr 11 15:38:18 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-8bef57d3-7cde-45f1-ada2-a6e77dc91965 req-0a6c9d63-f9fa-4bbf-845b-2f292e71a154 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031106 Apr 11 15:38:18 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 226/680] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:38:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:38:18 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Going to try to terminate instance {{(pid=61167) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:38:18 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/85658a44-9ff2-4553-b9fd-686bf35fd6ec" status: 204 len: 0 microversion: 2.1 time: 0.136889 Apr 11 15:38:18 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 230/681] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:38:18 2023] DELETE /compute/v2.1/servers/85658a44-9ff2-4553-b9fd-686bf35fd6ec => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:38:18 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-88b435f9-93d3-423a-8214-60a3506c5691 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:38:18 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-88b435f9-93d3-423a-8214-60a3506c5691 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:38:18 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-88b435f9-93d3-423a-8214-60a3506c5691 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:38:18 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-88b435f9-93d3-423a-8214-60a3506c5691 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:38:18 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-88b435f9-93d3-423a-8214-60a3506c5691 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:38:18 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-88b435f9-93d3-423a-8214-60a3506c5691 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:38:18 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-88b435f9-93d3-423a-8214-60a3506c5691 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:38:18 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-88b435f9-93d3-423a-8214-60a3506c5691 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:38:18 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-88b435f9-93d3-423a-8214-60a3506c5691 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402ec212c8a64a559f82c166070a92ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f7abe5e3144c7ab354ffaba1748616', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:38:18 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-88b435f9-93d3-423a-8214-60a3506c5691 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85658a44-9ff2-4553-b9fd-686bf35fd6ec" status: 200 len: 1662 microversion: 2.1 time: 0.208977 Apr 11 15:38:18 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 226/682] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:38:18 2023] GET /compute/v2.1/servers/85658a44-9ff2-4553-b9fd-686bf35fd6ec => generated 1662 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:38:18 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-da870bb4-232f-472a-9794-0b7d1fa42889 req-ebad6eb2-5789-4090-8b72-f9fb1c5e556f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85658a44-9ff2-4553-b9fd-686bf35fd6ec", "name": "network-vif-unplugged", "status": "completed", "tag": "c6826c01-eadd-49db-a842-accd25f7534a"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:38:18 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-da870bb4-232f-472a-9794-0b7d1fa42889 req-ebad6eb2-5789-4090-8b72-f9fb1c5e556f service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:38:18 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-da870bb4-232f-472a-9794-0b7d1fa42889 req-ebad6eb2-5789-4090-8b72-f9fb1c5e556f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:38:18 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-da870bb4-232f-472a-9794-0b7d1fa42889 req-ebad6eb2-5789-4090-8b72-f9fb1c5e556f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:38:18 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-da870bb4-232f-472a-9794-0b7d1fa42889 req-ebad6eb2-5789-4090-8b72-f9fb1c5e556f service nova] Creating event network-vif-unplugged:c6826c01-eadd-49db-a842-accd25f7534a for instance 85658a44-9ff2-4553-b9fd-686bf35fd6ec on user Apr 11 15:38:18 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-da870bb4-232f-472a-9794-0b7d1fa42889 req-ebad6eb2-5789-4090-8b72-f9fb1c5e556f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032474 Apr 11 15:38:18 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 227/683] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:38:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:38:20 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-c902a5d1-c35f-4eea-bb2b-c3c7570c5e6a req-1206109b-8edb-4559-a90b-495227fe1511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85658a44-9ff2-4553-b9fd-686bf35fd6ec", "name": "network-vif-plugged", "status": "completed", "tag": "c6826c01-eadd-49db-a842-accd25f7534a"}, {"server_uuid": "85658a44-9ff2-4553-b9fd-686bf35fd6ec", "name": "network-vif-deleted", "tag": "c6826c01-eadd-49db-a842-accd25f7534a"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:38:20 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-c902a5d1-c35f-4eea-bb2b-c3c7570c5e6a req-1206109b-8edb-4559-a90b-495227fe1511 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:38:20 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-c902a5d1-c35f-4eea-bb2b-c3c7570c5e6a req-1206109b-8edb-4559-a90b-495227fe1511 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:38:20 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-c902a5d1-c35f-4eea-bb2b-c3c7570c5e6a req-1206109b-8edb-4559-a90b-495227fe1511 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:38:20 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-c902a5d1-c35f-4eea-bb2b-c3c7570c5e6a req-1206109b-8edb-4559-a90b-495227fe1511 service nova] Creating event network-vif-plugged:c6826c01-eadd-49db-a842-accd25f7534a for instance 85658a44-9ff2-4553-b9fd-686bf35fd6ec on user Apr 11 15:38:20 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-c902a5d1-c35f-4eea-bb2b-c3c7570c5e6a req-1206109b-8edb-4559-a90b-495227fe1511 service nova] Creating event network-vif-deleted:c6826c01-eadd-49db-a842-accd25f7534a for instance 85658a44-9ff2-4553-b9fd-686bf35fd6ec on user Apr 11 15:38:20 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-c902a5d1-c35f-4eea-bb2b-c3c7570c5e6a req-1206109b-8edb-4559-a90b-495227fe1511 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031429 Apr 11 15:38:20 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 231/684] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:38:20 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:38:33 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:38:33 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=12 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:38:33 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-3b31a9b9-9f26-469f-bf8a-c083543de300 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:38:33 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-3b31a9b9-9f26-469f-bf8a-c083543de300 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:38:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-3b31a9b9-9f26-469f-bf8a-c083543de300 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:38:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-3b31a9b9-9f26-469f-bf8a-c083543de300 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:38:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-3b31a9b9-9f26-469f-bf8a-c083543de300 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:38:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-3b31a9b9-9f26-469f-bf8a-c083543de300 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:38:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-3b31a9b9-9f26-469f-bf8a-c083543de300 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:38:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-3b31a9b9-9f26-469f-bf8a-c083543de300 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:38:33 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-3b31a9b9-9f26-469f-bf8a-c083543de300 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8492f96e5d4f54aaae3679c82b6759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd700a53aa25849e0afd562b05881d09a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:38:33 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-3b31a9b9-9f26-469f-bf8a-c083543de300 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/058df5ba-07ab-4bdd-9a47-907e7b0e0e59" status: 200 len: 1490 microversion: 2.1 time: 0.144134 Apr 11 15:38:33 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 227/685] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:38:33 2023] GET /compute/v2.1/servers/058df5ba-07ab-4bdd-9a47-907e7b0e0e59 => generated 1490 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:38:37 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:38:37 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:38:37 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-e5ed55f1-53e4-46d7-8028-2f4f411b2063 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:38:37 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-e5ed55f1-53e4-46d7-8028-2f4f411b2063 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:38:37 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e5ed55f1-53e4-46d7-8028-2f4f411b2063 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:38:37 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e5ed55f1-53e4-46d7-8028-2f4f411b2063 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:38:37 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e5ed55f1-53e4-46d7-8028-2f4f411b2063 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:38:37 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e5ed55f1-53e4-46d7-8028-2f4f411b2063 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:38:37 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e5ed55f1-53e4-46d7-8028-2f4f411b2063 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:38:37 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e5ed55f1-53e4-46d7-8028-2f4f411b2063 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:38:37 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-e5ed55f1-53e4-46d7-8028-2f4f411b2063 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044f17aee3324b3a97bebe935548b3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23461a3d7ca49f6a77d3fde6f1009d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:38:37 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-e5ed55f1-53e4-46d7-8028-2f4f411b2063 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8" status: 200 len: 1749 microversion: 2.1 time: 0.162045 Apr 11 15:38:37 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 228/686] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:38:37 2023] GET /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8 => generated 1749 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:38:49 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:38:49 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:38:49 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-7ec157f6-b633-4dcf-bc52-721cf99716fb tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:38:49 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-7ec157f6-b633-4dcf-bc52-721cf99716fb tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:38:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7ec157f6-b633-4dcf-bc52-721cf99716fb tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:38:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7ec157f6-b633-4dcf-bc52-721cf99716fb tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:38:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7ec157f6-b633-4dcf-bc52-721cf99716fb tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:38:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7ec157f6-b633-4dcf-bc52-721cf99716fb tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:38:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7ec157f6-b633-4dcf-bc52-721cf99716fb tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:38:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7ec157f6-b633-4dcf-bc52-721cf99716fb tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:38:49 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-7ec157f6-b633-4dcf-bc52-721cf99716fb tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] HTTP exception thrown: Instance d09cda86-eca1-4c42-8654-758eb6cd30e0 could not be found. Apr 11 15:38:49 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-7ec157f6-b633-4dcf-bc52-721cf99716fb tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Request method failure captured: Apr 11 15:38:49 user devstack@n-api.service[61167]: request: GET /compute/v2.1/servers/d09cda86-eca1-4c42-8654-758eb6cd30e0 HTTP/1.1 Apr 11 15:38:49 user devstack@n-api.service[61167]: Accept: application/json Apr 11 15:38:49 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 15:38:49 user devstack@n-api.service[61167]: Connection: close Apr 11 15:38:49 user devstack@n-api.service[61167]: Content-Length: 0 Apr 11 15:38:49 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 15:38:49 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 15:38:49 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 15:38:49 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 15:38:49 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNXrTxmYoUPbA1Vrii2KAgpzDULSyiL1qGl8ysTTiP7FHcjwwJ2tMcOq2-bqdklTWlpKEHoEklslzx7mAtK1aZZWTMLRybETvT8MXnGulH_rR9jL3ju6Sx2nCkQ6LJJ70mflSFhe1N0Vreir0B8yLa_h-LXbwY6x21c0oDG6hH50MHM8 Apr 11 15:38:49 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 15:38:49 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 15:38:49 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 15:38:49 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 15:38:49 user devstack@n-api.service[61167]: X-Openstack-Nova-Api-Version: 2.87 Apr 11 15:38:49 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 15:38:49 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 15:38:49 user devstack@n-api.service[61167]: X-Project-Id: ddc05e9bf5ab426982ccb3092ad596e4 Apr 11 15:38:49 user devstack@n-api.service[61167]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1907753459 Apr 11 15:38:49 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 15:38:49 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 15:38:49 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ddc05e9bf5ab426982ccb3092ad596e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ddc05e9bf5ab426982ccb3092ad596e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ddc05e9bf5ab426982ccb3092ad596e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:38:49 user devstack@n-api.service[61167]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1907753459 Apr 11 15:38:49 user devstack@n-api.service[61167]: X-Tenant-Id: ddc05e9bf5ab426982ccb3092ad596e4 Apr 11 15:38:49 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1907753459 Apr 11 15:38:49 user devstack@n-api.service[61167]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member Apr 11 15:38:49 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 15:38:49 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 15:38:49 user devstack@n-api.service[61167]: X-User-Id: 1d60ce27bfad4d7c9b976e834df35ad4 Apr 11 15:38:49 user devstack@n-api.service[61167]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member Apr 11 15:38:49 user devstack@n-api.service[61167]: method: > Apr 11 15:38:49 user devstack@n-api.service[61167]: exception: Instance d09cda86-eca1-4c42-8654-758eb6cd30e0 could not be found. Apr 11 15:38:49 user devstack@n-api.service[61167]: action_args: {'id': 'd09cda86-eca1-4c42-8654-758eb6cd30e0'} Apr 11 15:38:49 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d09cda86-eca1-4c42-8654-758eb6cd30e0 could not be found. Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d09cda86-eca1-4c42-8654-758eb6cd30e0 could not be found. Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d09cda86-eca1-4c42-8654-758eb6cd30e0 could not be found. Apr 11 15:38:49 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:38:49 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-7ec157f6-b633-4dcf-bc52-721cf99716fb tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Returning 404 to user: Instance d09cda86-eca1-4c42-8654-758eb6cd30e0 could not be found. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:38:49 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-7ec157f6-b633-4dcf-bc52-721cf99716fb tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d09cda86-eca1-4c42-8654-758eb6cd30e0" status: 404 len: 111 microversion: 2.87 time: 0.037092 Apr 11 15:38:49 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 232/687] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:38:49 2023] GET /compute/v2.1/servers/d09cda86-eca1-4c42-8654-758eb6cd30e0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 15:38:49 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:38:49 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:38:49 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:38:49 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:38:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:38:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:38:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:38:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:38:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:38:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:38:49 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Going to try to terminate instance {{(pid=61165) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:38:49 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7c4329ae-07cb-4f28-9fd6-29b398517d2b" status: 204 len: 0 microversion: 2.87 time: 0.125961 Apr 11 15:38:49 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 228/688] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 15:38:49 2023] DELETE /compute/v2.1/servers/7c4329ae-07cb-4f28-9fd6-29b398517d2b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 15:38:49 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-c18629e3-153c-4304-92f2-71f5aaf5bc46 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:38:49 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-c18629e3-153c-4304-92f2-71f5aaf5bc46 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:38:49 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:38:49 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:38:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c18629e3-153c-4304-92f2-71f5aaf5bc46 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:38:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c18629e3-153c-4304-92f2-71f5aaf5bc46 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:38:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c18629e3-153c-4304-92f2-71f5aaf5bc46 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:38:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c18629e3-153c-4304-92f2-71f5aaf5bc46 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:38:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c18629e3-153c-4304-92f2-71f5aaf5bc46 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:38:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c18629e3-153c-4304-92f2-71f5aaf5bc46 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:38:49 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-c18629e3-153c-4304-92f2-71f5aaf5bc46 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:38:49 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-c18629e3-153c-4304-92f2-71f5aaf5bc46 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:38:49 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-c18629e3-153c-4304-92f2-71f5aaf5bc46 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:38:49 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-c18629e3-153c-4304-92f2-71f5aaf5bc46 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c4329ae-07cb-4f28-9fd6-29b398517d2b" status: 200 len: 1696 microversion: 2.87 time: 0.202456 Apr 11 15:38:49 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 229/689] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:38:49 2023] GET /compute/v2.1/servers/7c4329ae-07cb-4f28-9fd6-29b398517d2b => generated 1696 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:38:49 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-c3afda89-adfb-4327-a30f-c70ddb9ff15f req-5848c47d-95e3-4188-a8b4-2d376d023e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c4329ae-07cb-4f28-9fd6-29b398517d2b", "name": "network-vif-unplugged", "status": "completed", "tag": "37d248cb-99ae-4dcd-adfe-46bce9920d3e"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:38:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-c3afda89-adfb-4327-a30f-c70ddb9ff15f req-5848c47d-95e3-4188-a8b4-2d376d023e11 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:38:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-c3afda89-adfb-4327-a30f-c70ddb9ff15f req-5848c47d-95e3-4188-a8b4-2d376d023e11 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:38:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-c3afda89-adfb-4327-a30f-c70ddb9ff15f req-5848c47d-95e3-4188-a8b4-2d376d023e11 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:38:49 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-c3afda89-adfb-4327-a30f-c70ddb9ff15f req-5848c47d-95e3-4188-a8b4-2d376d023e11 service nova] Creating event network-vif-unplugged:37d248cb-99ae-4dcd-adfe-46bce9920d3e for instance 7c4329ae-07cb-4f28-9fd6-29b398517d2b on user Apr 11 15:38:49 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-c3afda89-adfb-4327-a30f-c70ddb9ff15f req-5848c47d-95e3-4188-a8b4-2d376d023e11 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029040 Apr 11 15:38:49 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 233/690] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:38:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:38:50 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-a9b1c5f4-fa2d-480d-9f52-e29171480f50 req-5eeb9b3d-af6c-4d0f-8001-902b4c7e77d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c4329ae-07cb-4f28-9fd6-29b398517d2b", "name": "network-vif-deleted", "tag": "37d248cb-99ae-4dcd-adfe-46bce9920d3e"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:38:50 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-a9b1c5f4-fa2d-480d-9f52-e29171480f50 req-5eeb9b3d-af6c-4d0f-8001-902b4c7e77d5 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:38:50 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-a9b1c5f4-fa2d-480d-9f52-e29171480f50 req-5eeb9b3d-af6c-4d0f-8001-902b4c7e77d5 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:38:50 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-a9b1c5f4-fa2d-480d-9f52-e29171480f50 req-5eeb9b3d-af6c-4d0f-8001-902b4c7e77d5 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:38:50 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-a9b1c5f4-fa2d-480d-9f52-e29171480f50 req-5eeb9b3d-af6c-4d0f-8001-902b4c7e77d5 service nova] Creating event network-vif-deleted:37d248cb-99ae-4dcd-adfe-46bce9920d3e for instance 7c4329ae-07cb-4f28-9fd6-29b398517d2b on user Apr 11 15:38:50 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-a9b1c5f4-fa2d-480d-9f52-e29171480f50 req-5eeb9b3d-af6c-4d0f-8001-902b4c7e77d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032703 Apr 11 15:38:50 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 229/691] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:38:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:38:51 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c4329ae-07cb-4f28-9fd6-29b398517d2b", "name": "network-vif-plugged", "status": "completed", "tag": "37d248cb-99ae-4dcd-adfe-46bce9920d3e"}, {"server_uuid": "7c4329ae-07cb-4f28-9fd6-29b398517d2b", "name": "network-vif-plugged", "status": "completed", "tag": "37d248cb-99ae-4dcd-adfe-46bce9920d3e"}, {"server_uuid": "7c4329ae-07cb-4f28-9fd6-29b398517d2b", "name": "network-vif-plugged", "status": "completed", "tag": "37d248cb-99ae-4dcd-adfe-46bce9920d3e"}, {"server_uuid": "7c4329ae-07cb-4f28-9fd6-29b398517d2b", "name": "network-vif-unplugged", "status": "completed", "tag": "37d248cb-99ae-4dcd-adfe-46bce9920d3e"}, {"server_uuid": "7c4329ae-07cb-4f28-9fd6-29b398517d2b", "name": "network-vif-plugged", "status": "completed", "tag": "37d248cb-99ae-4dcd-adfe-46bce9920d3e"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:38:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:38:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:38:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:38:51 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] Creating event network-vif-plugged:37d248cb-99ae-4dcd-adfe-46bce9920d3e for instance 7c4329ae-07cb-4f28-9fd6-29b398517d2b on user Apr 11 15:38:51 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] Creating event network-vif-plugged:37d248cb-99ae-4dcd-adfe-46bce9920d3e for instance 7c4329ae-07cb-4f28-9fd6-29b398517d2b on user Apr 11 15:38:51 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] Creating event network-vif-plugged:37d248cb-99ae-4dcd-adfe-46bce9920d3e for instance 7c4329ae-07cb-4f28-9fd6-29b398517d2b on user Apr 11 15:38:51 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] Creating event network-vif-unplugged:37d248cb-99ae-4dcd-adfe-46bce9920d3e for instance 7c4329ae-07cb-4f28-9fd6-29b398517d2b on user Apr 11 15:38:51 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] Creating event network-vif-plugged:37d248cb-99ae-4dcd-adfe-46bce9920d3e for instance 7c4329ae-07cb-4f28-9fd6-29b398517d2b on user Apr 11 15:38:51 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.034153 Apr 11 15:38:51 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 230/692] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:38:51 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:39:08 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=4 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:39:08 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=4 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:39:08 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-4854ffb3-3eb8-497c-b181-e820d698dbd5 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:39:08 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-4854ffb3-3eb8-497c-b181-e820d698dbd5 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:39:08 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4854ffb3-3eb8-497c-b181-e820d698dbd5 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:08 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4854ffb3-3eb8-497c-b181-e820d698dbd5 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:08 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4854ffb3-3eb8-497c-b181-e820d698dbd5 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:08 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4854ffb3-3eb8-497c-b181-e820d698dbd5 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:08 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4854ffb3-3eb8-497c-b181-e820d698dbd5 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:08 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4854ffb3-3eb8-497c-b181-e820d698dbd5 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:08 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-4854ffb3-3eb8-497c-b181-e820d698dbd5 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] HTTP exception thrown: Instance 85658a44-9ff2-4553-b9fd-686bf35fd6ec could not be found. Apr 11 15:39:08 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-4854ffb3-3eb8-497c-b181-e820d698dbd5 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Request method failure captured: Apr 11 15:39:08 user devstack@n-api.service[61167]: request: GET /compute/v2.1/servers/85658a44-9ff2-4553-b9fd-686bf35fd6ec HTTP/1.1 Apr 11 15:39:08 user devstack@n-api.service[61167]: Accept: application/json Apr 11 15:39:08 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 15:39:08 user devstack@n-api.service[61167]: Connection: close Apr 11 15:39:08 user devstack@n-api.service[61167]: Content-Length: 0 Apr 11 15:39:08 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 15:39:08 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 15:39:08 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 15:39:08 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 15:39:08 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNX1J4AnrkqS0vi1kz5FsIapyiY_WastCT9YjOnhKxBWfpJGOOYFN188KiZdSMNxZKf5bXRske_YVpiDKkyudxMuI3xLYkawFSOK5Fqq2V2-deJT30SwtY9vjpiJV8kl-Y7G58eORL2apgqSmaKfZEzu_21xv4BO0fX0kr_uYhUSI_iQ Apr 11 15:39:08 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 15:39:08 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 15:39:08 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 15:39:08 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 15:39:08 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 15:39:08 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 15:39:08 user devstack@n-api.service[61167]: X-Project-Id: f0f7abe5e3144c7ab354ffaba1748616 Apr 11 15:39:08 user devstack@n-api.service[61167]: X-Project-Name: tempest-TestStampPattern-344874523 Apr 11 15:39:08 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 15:39:08 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 15:39:08 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0f7abe5e3144c7ab354ffaba1748616"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f0f7abe5e3144c7ab354ffaba1748616"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0f7abe5e3144c7ab354ffaba1748616"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:39:08 user devstack@n-api.service[61167]: X-Tenant: tempest-TestStampPattern-344874523 Apr 11 15:39:08 user devstack@n-api.service[61167]: X-Tenant-Id: f0f7abe5e3144c7ab354ffaba1748616 Apr 11 15:39:08 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-TestStampPattern-344874523 Apr 11 15:39:08 user devstack@n-api.service[61167]: X-User: tempest-TestStampPattern-344874523-project-member Apr 11 15:39:08 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 15:39:08 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 15:39:08 user devstack@n-api.service[61167]: X-User-Id: 402ec212c8a64a559f82c166070a92ef Apr 11 15:39:08 user devstack@n-api.service[61167]: X-User-Name: tempest-TestStampPattern-344874523-project-member Apr 11 15:39:08 user devstack@n-api.service[61167]: method: > Apr 11 15:39:08 user devstack@n-api.service[61167]: exception: Instance 85658a44-9ff2-4553-b9fd-686bf35fd6ec could not be found. Apr 11 15:39:08 user devstack@n-api.service[61167]: action_args: {'id': '85658a44-9ff2-4553-b9fd-686bf35fd6ec'} Apr 11 15:39:08 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85658a44-9ff2-4553-b9fd-686bf35fd6ec could not be found. Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85658a44-9ff2-4553-b9fd-686bf35fd6ec could not be found. Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85658a44-9ff2-4553-b9fd-686bf35fd6ec could not be found. Apr 11 15:39:08 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:39:08 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-4854ffb3-3eb8-497c-b181-e820d698dbd5 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Returning 404 to user: Instance 85658a44-9ff2-4553-b9fd-686bf35fd6ec could not be found. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:39:08 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-4854ffb3-3eb8-497c-b181-e820d698dbd5 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85658a44-9ff2-4553-b9fd-686bf35fd6ec" status: 404 len: 111 microversion: 2.1 time: 0.049013 Apr 11 15:39:08 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 234/693] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:39:08 2023] GET /compute/v2.1/servers/85658a44-9ff2-4553-b9fd-686bf35fd6ec => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:39:08 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:39:08 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:39:08 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-582cec41-b233-449f-b1d4-5644cc10a2a9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:39:08 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-582cec41-b233-449f-b1d4-5644cc10a2a9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:39:08 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-582cec41-b233-449f-b1d4-5644cc10a2a9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:08 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-582cec41-b233-449f-b1d4-5644cc10a2a9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:08 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-582cec41-b233-449f-b1d4-5644cc10a2a9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:08 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-582cec41-b233-449f-b1d4-5644cc10a2a9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:08 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-582cec41-b233-449f-b1d4-5644cc10a2a9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:08 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-582cec41-b233-449f-b1d4-5644cc10a2a9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:09 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-582cec41-b233-449f-b1d4-5644cc10a2a9 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.113428 Apr 11 15:39:09 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 230/694] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 15:39:08 2023] GET /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4/os-interface => generated 282 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:39:09 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:39:09 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=8 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:39:09 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-db7b6587-3cab-4c10-8cc9-0512603d8fd7 req-80cb05f3-a719-4665-9a12-f564382c7465 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcbfcbfd-7e96-4271-94ee-60ef937e3b7e", "tag": "32c006ee-14e2-47d8-b999-bafc729aa67a"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:39:09 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-db7b6587-3cab-4c10-8cc9-0512603d8fd7 req-80cb05f3-a719-4665-9a12-f564382c7465 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:09 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-02eba20f-cf4e-44a6-8dd8-7ee96f862b93 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:39:09 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-02eba20f-cf4e-44a6-8dd8-7ee96f862b93 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:39:09 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-db7b6587-3cab-4c10-8cc9-0512603d8fd7 req-80cb05f3-a719-4665-9a12-f564382c7465 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:09 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-db7b6587-3cab-4c10-8cc9-0512603d8fd7 req-80cb05f3-a719-4665-9a12-f564382c7465 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:09 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-02eba20f-cf4e-44a6-8dd8-7ee96f862b93 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:09 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-02eba20f-cf4e-44a6-8dd8-7ee96f862b93 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:09 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-02eba20f-cf4e-44a6-8dd8-7ee96f862b93 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:09 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-02eba20f-cf4e-44a6-8dd8-7ee96f862b93 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:09 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-02eba20f-cf4e-44a6-8dd8-7ee96f862b93 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:09 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-02eba20f-cf4e-44a6-8dd8-7ee96f862b93 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:10 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-db7b6587-3cab-4c10-8cc9-0512603d8fd7 req-80cb05f3-a719-4665-9a12-f564382c7465 service nova] Creating event network-changed:32c006ee-14e2-47d8-b999-bafc729aa67a for instance dcbfcbfd-7e96-4271-94ee-60ef937e3b7e on user Apr 11 15:39:10 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-db7b6587-3cab-4c10-8cc9-0512603d8fd7 req-80cb05f3-a719-4665-9a12-f564382c7465 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092048 Apr 11 15:39:10 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 231/695] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:39:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:39:10 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-02eba20f-cf4e-44a6-8dd8-7ee96f862b93 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:39:10 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-02eba20f-cf4e-44a6-8dd8-7ee96f862b93 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4" status: 200 len: 1427 microversion: 2.1 time: 0.179289 Apr 11 15:39:10 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 235/696] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:39:09 2023] GET /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4 => generated 1427 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:39:10 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:39:10 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:39:10 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:10 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:10 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:10 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:10 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:10 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:10 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:39:10 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Old instance type m1.nano, new instance type m1.micro {{(pid=61165) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 11 15:39:10 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:10 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:10 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:10 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:10 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:10 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:10 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-c546a74b-f7ef-4e22-95c7-999d1683c82a tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Calling method '.version_select at 0x7f4c2ec681f0>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:39:10 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Getting quotas for project bb7660e8f76b471487136806ee9eec62. Resources: {'cores', 'ram'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:39:10 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Getting quotas for user 10720df0ac4f4e62a0a5c9883d600add and project bb7660e8f76b471487136806ee9eec62. Resources: {'cores', 'ram'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:39:10 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-c546a74b-f7ef-4e22-95c7-999d1683c82a tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-416277054" status: 202 len: 0 microversion: 2.1 time: 0.040601 Apr 11 15:39:10 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 232/697] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 15:39:10 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-416277054 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:39:10 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Flavor limits 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:39:10 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Image limits 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:39:10 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Flavor pref 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:39:10 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Image pref 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:39:10 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:39:10 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4/action" status: 202 len: 0 microversion: 2.1 time: 0.189656 Apr 11 15:39:10 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 231/698] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 15:39:10 2023] POST /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:39:10 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-8151e93c-ff4c-472c-92ea-6cb9a91f1de1 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:39:10 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-8151e93c-ff4c-472c-92ea-6cb9a91f1de1 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:39:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8151e93c-ff4c-472c-92ea-6cb9a91f1de1 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8151e93c-ff4c-472c-92ea-6cb9a91f1de1 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8151e93c-ff4c-472c-92ea-6cb9a91f1de1 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8151e93c-ff4c-472c-92ea-6cb9a91f1de1 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8151e93c-ff4c-472c-92ea-6cb9a91f1de1 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8151e93c-ff4c-472c-92ea-6cb9a91f1de1 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:10 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-8151e93c-ff4c-472c-92ea-6cb9a91f1de1 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:39:10 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-8151e93c-ff4c-472c-92ea-6cb9a91f1de1 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4" status: 200 len: 1436 microversion: 2.1 time: 0.246461 Apr 11 15:39:10 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 236/699] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:39:10 2023] GET /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4 => generated 1436 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 15:39:12 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-4b6ca4d0-fba3-4d91-b6be-3bdbb8800844 req-b1fec393-2f37-4f5b-87fa-c4d87ca89c19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffce2921-d4a5-4bcb-8032-62a6dc321fb4", "tag": "910fb3d4-3965-41a2-8f97-9de79ee78c78"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:39:12 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-4b6ca4d0-fba3-4d91-b6be-3bdbb8800844 req-b1fec393-2f37-4f5b-87fa-c4d87ca89c19 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:12 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-4b6ca4d0-fba3-4d91-b6be-3bdbb8800844 req-b1fec393-2f37-4f5b-87fa-c4d87ca89c19 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:12 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-4b6ca4d0-fba3-4d91-b6be-3bdbb8800844 req-b1fec393-2f37-4f5b-87fa-c4d87ca89c19 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:12 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-4b6ca4d0-fba3-4d91-b6be-3bdbb8800844 req-b1fec393-2f37-4f5b-87fa-c4d87ca89c19 service nova] Creating event network-changed:910fb3d4-3965-41a2-8f97-9de79ee78c78 for instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 on user Apr 11 15:39:12 user devstack@n-api.service[61166]: DEBUG nova.compute.api [req-4b6ca4d0-fba3-4d91-b6be-3bdbb8800844 req-b1fec393-2f37-4f5b-87fa-c4d87ca89c19 service nova] Instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61166) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 15:39:12 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-4b6ca4d0-fba3-4d91-b6be-3bdbb8800844 req-b1fec393-2f37-4f5b-87fa-c4d87ca89c19 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042793 Apr 11 15:39:12 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 233/700] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:39:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:39:13 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-3c66c8f9-44fd-45dd-955c-dab76aa964a5 req-4fd92a9b-e45a-4662-a5ef-74436639d48e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffce2921-d4a5-4bcb-8032-62a6dc321fb4", "name": "network-vif-unplugged", "status": "completed", "tag": "910fb3d4-3965-41a2-8f97-9de79ee78c78"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:39:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-3c66c8f9-44fd-45dd-955c-dab76aa964a5 req-4fd92a9b-e45a-4662-a5ef-74436639d48e service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-3c66c8f9-44fd-45dd-955c-dab76aa964a5 req-4fd92a9b-e45a-4662-a5ef-74436639d48e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-3c66c8f9-44fd-45dd-955c-dab76aa964a5 req-4fd92a9b-e45a-4662-a5ef-74436639d48e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:13 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-3c66c8f9-44fd-45dd-955c-dab76aa964a5 req-4fd92a9b-e45a-4662-a5ef-74436639d48e service nova] Creating event network-vif-unplugged:910fb3d4-3965-41a2-8f97-9de79ee78c78 for instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 on user Apr 11 15:39:13 user devstack@n-api.service[61165]: DEBUG nova.compute.api [req-3c66c8f9-44fd-45dd-955c-dab76aa964a5 req-4fd92a9b-e45a-4662-a5ef-74436639d48e service nova] Instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61165) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 15:39:13 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-3c66c8f9-44fd-45dd-955c-dab76aa964a5 req-4fd92a9b-e45a-4662-a5ef-74436639d48e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038790 Apr 11 15:39:13 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 232/701] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:39:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:39:15 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-de7efa11-2283-4ccb-b79f-39283828086a req-76d273f2-72f2-4b8a-b8cf-9a01f7a42560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffce2921-d4a5-4bcb-8032-62a6dc321fb4", "name": "network-vif-plugged", "status": "completed", "tag": "910fb3d4-3965-41a2-8f97-9de79ee78c78"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:39:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-de7efa11-2283-4ccb-b79f-39283828086a req-76d273f2-72f2-4b8a-b8cf-9a01f7a42560 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-de7efa11-2283-4ccb-b79f-39283828086a req-76d273f2-72f2-4b8a-b8cf-9a01f7a42560 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-de7efa11-2283-4ccb-b79f-39283828086a req-76d273f2-72f2-4b8a-b8cf-9a01f7a42560 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:15 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-de7efa11-2283-4ccb-b79f-39283828086a req-76d273f2-72f2-4b8a-b8cf-9a01f7a42560 service nova] Creating event network-vif-plugged:910fb3d4-3965-41a2-8f97-9de79ee78c78 for instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 on user Apr 11 15:39:15 user devstack@n-api.service[61167]: DEBUG nova.compute.api [req-de7efa11-2283-4ccb-b79f-39283828086a req-76d273f2-72f2-4b8a-b8cf-9a01f7a42560 service nova] Instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 15:39:15 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-de7efa11-2283-4ccb-b79f-39283828086a req-76d273f2-72f2-4b8a-b8cf-9a01f7a42560 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039773 Apr 11 15:39:15 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 237/702] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:39:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:39:24 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:39:24 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:39:24 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-3d899e06-9d62-4b25-850d-b1f27de9c83b req-6c23af19-2133-4d26-a250-3bfd83c8f623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffce2921-d4a5-4bcb-8032-62a6dc321fb4", "name": "network-vif-plugged", "status": "completed", "tag": "910fb3d4-3965-41a2-8f97-9de79ee78c78"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:39:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-3d899e06-9d62-4b25-850d-b1f27de9c83b req-6c23af19-2133-4d26-a250-3bfd83c8f623 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-3d899e06-9d62-4b25-850d-b1f27de9c83b req-6c23af19-2133-4d26-a250-3bfd83c8f623 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-3d899e06-9d62-4b25-850d-b1f27de9c83b req-6c23af19-2133-4d26-a250-3bfd83c8f623 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:24 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-3d899e06-9d62-4b25-850d-b1f27de9c83b req-6c23af19-2133-4d26-a250-3bfd83c8f623 service nova] Creating event network-vif-plugged:910fb3d4-3965-41a2-8f97-9de79ee78c78 for instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 on user Apr 11 15:39:24 user devstack@n-api.service[61166]: DEBUG nova.compute.api [req-3d899e06-9d62-4b25-850d-b1f27de9c83b req-6c23af19-2133-4d26-a250-3bfd83c8f623 service nova] Instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61166) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 15:39:24 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-3d899e06-9d62-4b25-850d-b1f27de9c83b req-6c23af19-2133-4d26-a250-3bfd83c8f623 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042685 Apr 11 15:39:24 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 234/703] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:39:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:39:26 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=3 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:39:26 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=18 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:39:26 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:39:26 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-124a8bfc-ec8d-491c-a44e-bb102d167a0e req-430d2938-04b9-44c9-8038-b9c6b5aa98c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffce2921-d4a5-4bcb-8032-62a6dc321fb4", "name": "network-vif-plugged", "status": "completed", "tag": "910fb3d4-3965-41a2-8f97-9de79ee78c78"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:39:26 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-124a8bfc-ec8d-491c-a44e-bb102d167a0e req-430d2938-04b9-44c9-8038-b9c6b5aa98c2 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:26 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-124a8bfc-ec8d-491c-a44e-bb102d167a0e req-430d2938-04b9-44c9-8038-b9c6b5aa98c2 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:26 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-124a8bfc-ec8d-491c-a44e-bb102d167a0e req-430d2938-04b9-44c9-8038-b9c6b5aa98c2 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:26 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-124a8bfc-ec8d-491c-a44e-bb102d167a0e req-430d2938-04b9-44c9-8038-b9c6b5aa98c2 service nova] Creating event network-vif-plugged:910fb3d4-3965-41a2-8f97-9de79ee78c78 for instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 on user Apr 11 15:39:26 user devstack@n-api.service[61165]: DEBUG nova.compute.api [req-124a8bfc-ec8d-491c-a44e-bb102d167a0e req-430d2938-04b9-44c9-8038-b9c6b5aa98c2 service nova] Instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61165) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 15:39:26 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-124a8bfc-ec8d-491c-a44e-bb102d167a0e req-430d2938-04b9-44c9-8038-b9c6b5aa98c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048741 Apr 11 15:39:26 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 233/704] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:39:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:39:33 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=8 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:39:33 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=18 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:39:33 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-f948c484-84c6-4f2a-8ad6-a233b2765a21 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:39:33 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-f948c484-84c6-4f2a-8ad6-a233b2765a21 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:39:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f948c484-84c6-4f2a-8ad6-a233b2765a21 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f948c484-84c6-4f2a-8ad6-a233b2765a21 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f948c484-84c6-4f2a-8ad6-a233b2765a21 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f948c484-84c6-4f2a-8ad6-a233b2765a21 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f948c484-84c6-4f2a-8ad6-a233b2765a21 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f948c484-84c6-4f2a-8ad6-a233b2765a21 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:33 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-f948c484-84c6-4f2a-8ad6-a233b2765a21 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8492f96e5d4f54aaae3679c82b6759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd700a53aa25849e0afd562b05881d09a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:39:33 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-f948c484-84c6-4f2a-8ad6-a233b2765a21 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f6ae64a-c760-4ba3-8a50-d380835d9913" status: 200 len: 1505 microversion: 2.1 time: 0.145729 Apr 11 15:39:33 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 238/705] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:39:33 2023] GET /compute/v2.1/servers/6f6ae64a-c760-4ba3-8a50-d380835d9913 => generated 1505 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:39:37 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:39:37 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:39:37 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-4f6908ae-4d02-4a67-aed1-d2210602ba3a tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1561016162"}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:39:37 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-4f6908ae-4d02-4a67-aed1-d2210602ba3a tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:39:37 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4f6908ae-4d02-4a67-aed1-d2210602ba3a tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:37 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4f6908ae-4d02-4a67-aed1-d2210602ba3a tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:37 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4f6908ae-4d02-4a67-aed1-d2210602ba3a tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:37 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4f6908ae-4d02-4a67-aed1-d2210602ba3a tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:37 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4f6908ae-4d02-4a67-aed1-d2210602ba3a tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:37 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4f6908ae-4d02-4a67-aed1-d2210602ba3a tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:37 user devstack@n-api.service[61166]: INFO nova.network.security_group_api [None req-4f6908ae-4d02-4a67-aed1-d2210602ba3a tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Removing security group ca3e544b-3cf1-409d-b659-b416a021176f from port 19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 Apr 11 15:39:38 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-4f6908ae-4d02-4a67-aed1-d2210602ba3a tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/action" status: 202 len: 0 microversion: 2.1 time: 0.606662 Apr 11 15:39:38 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 235/706] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 15:39:37 2023] POST /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/action => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:39:38 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:39:38 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:39:38 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-8171a9bf-2018-4d85-9a2b-97d3db740a54 req-d054e17a-6042-4ae3-a373-6a721130bd7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e3d0956-d528-4097-a200-d9b2b6ce7aa8", "tag": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:39:38 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-8171a9bf-2018-4d85-9a2b-97d3db740a54 req-d054e17a-6042-4ae3-a373-6a721130bd7b service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:38 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-8171a9bf-2018-4d85-9a2b-97d3db740a54 req-d054e17a-6042-4ae3-a373-6a721130bd7b service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:38 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-8171a9bf-2018-4d85-9a2b-97d3db740a54 req-d054e17a-6042-4ae3-a373-6a721130bd7b service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:38 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-8171a9bf-2018-4d85-9a2b-97d3db740a54 req-d054e17a-6042-4ae3-a373-6a721130bd7b service nova] Creating event network-changed:19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 for instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 on user Apr 11 15:39:38 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-8171a9bf-2018-4d85-9a2b-97d3db740a54 req-d054e17a-6042-4ae3-a373-6a721130bd7b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033230 Apr 11 15:39:38 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 234/707] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:39:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:39:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-173b8fb2-67f9-4ff9-95ba-f8ac837571a7 req-2314a00e-486a-4779-821a-1c34cb2d1055 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e3d0956-d528-4097-a200-d9b2b6ce7aa8", "tag": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:39:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-173b8fb2-67f9-4ff9-95ba-f8ac837571a7 req-2314a00e-486a-4779-821a-1c34cb2d1055 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-173b8fb2-67f9-4ff9-95ba-f8ac837571a7 req-2314a00e-486a-4779-821a-1c34cb2d1055 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-173b8fb2-67f9-4ff9-95ba-f8ac837571a7 req-2314a00e-486a-4779-821a-1c34cb2d1055 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:39 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-173b8fb2-67f9-4ff9-95ba-f8ac837571a7 req-2314a00e-486a-4779-821a-1c34cb2d1055 service nova] Creating event network-changed:19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 for instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 on user Apr 11 15:39:39 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-173b8fb2-67f9-4ff9-95ba-f8ac837571a7 req-2314a00e-486a-4779-821a-1c34cb2d1055 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027124 Apr 11 15:39:39 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 239/708] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:39:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:39:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:39:39 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:39:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:39 user devstack@n-api.service[61166]: DEBUG nova.objects.instance [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lazy-loading 'services' on Instance uuid 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 {{(pid=61166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 15:39:39 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/os-volume_attachments/6119ec74-db79-4b19-9bf7-44cc8a4d853a" status: 202 len: 0 microversion: 2.1 time: 0.180418 Apr 11 15:39:39 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 236/709] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 15:39:39 2023] DELETE /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/os-volume_attachments/6119ec74-db79-4b19-9bf7-44cc8a4d853a => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:39:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-2b992321-f639-42dc-adac-4d4f4f191dd0 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:39:39 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-2b992321-f639-42dc-adac-4d4f4f191dd0 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:39:39 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-2b992321-f639-42dc-adac-4d4f4f191dd0 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:39 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-2b992321-f639-42dc-adac-4d4f4f191dd0 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:39 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-2b992321-f639-42dc-adac-4d4f4f191dd0 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:39 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-2b992321-f639-42dc-adac-4d4f4f191dd0 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:39 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-2b992321-f639-42dc-adac-4d4f4f191dd0 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:39 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-2b992321-f639-42dc-adac-4d4f4f191dd0 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:39 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-2b992321-f639-42dc-adac-4d4f4f191dd0 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048715 Apr 11 15:39:39 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 235/710] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:39:39 2023] GET /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:39:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-4d4b7a40-e09b-4afe-9d2c-40792035aae6 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:39:39 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-4d4b7a40-e09b-4afe-9d2c-40792035aae6 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:39:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4d4b7a40-e09b-4afe-9d2c-40792035aae6 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4d4b7a40-e09b-4afe-9d2c-40792035aae6 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4d4b7a40-e09b-4afe-9d2c-40792035aae6 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4d4b7a40-e09b-4afe-9d2c-40792035aae6 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4d4b7a40-e09b-4afe-9d2c-40792035aae6 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4d4b7a40-e09b-4afe-9d2c-40792035aae6 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:39 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-4d4b7a40-e09b-4afe-9d2c-40792035aae6 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] HTTP exception thrown: Instance 7c4329ae-07cb-4f28-9fd6-29b398517d2b could not be found. Apr 11 15:39:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-4d4b7a40-e09b-4afe-9d2c-40792035aae6 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Request method failure captured: Apr 11 15:39:39 user devstack@n-api.service[61167]: request: GET /compute/v2.1/servers/7c4329ae-07cb-4f28-9fd6-29b398517d2b HTTP/1.1 Apr 11 15:39:39 user devstack@n-api.service[61167]: Accept: application/json Apr 11 15:39:39 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 15:39:39 user devstack@n-api.service[61167]: Connection: close Apr 11 15:39:39 user devstack@n-api.service[61167]: Content-Length: 0 Apr 11 15:39:39 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 15:39:39 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 15:39:39 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 15:39:39 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 15:39:39 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNXrTxmYoUPbA1Vrii2KAgpzDULSyiL1qGl8ysTTiP7FHcjwwJ2tMcOq2-bqdklTWlpKEHoEklslzx7mAtK1aZZWTMLRybETvT8MXnGulH_rR9jL3ju6Sx2nCkQ6LJJ70mflSFhe1N0Vreir0B8yLa_h-LXbwY6x21c0oDG6hH50MHM8 Apr 11 15:39:39 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 15:39:39 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 15:39:39 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 15:39:39 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 15:39:39 user devstack@n-api.service[61167]: X-Openstack-Nova-Api-Version: 2.87 Apr 11 15:39:39 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 15:39:39 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 15:39:39 user devstack@n-api.service[61167]: X-Project-Id: ddc05e9bf5ab426982ccb3092ad596e4 Apr 11 15:39:39 user devstack@n-api.service[61167]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1907753459 Apr 11 15:39:39 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 15:39:39 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 15:39:39 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ddc05e9bf5ab426982ccb3092ad596e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ddc05e9bf5ab426982ccb3092ad596e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ddc05e9bf5ab426982ccb3092ad596e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:39:39 user devstack@n-api.service[61167]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1907753459 Apr 11 15:39:39 user devstack@n-api.service[61167]: X-Tenant-Id: ddc05e9bf5ab426982ccb3092ad596e4 Apr 11 15:39:39 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1907753459 Apr 11 15:39:39 user devstack@n-api.service[61167]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member Apr 11 15:39:39 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 15:39:39 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 15:39:39 user devstack@n-api.service[61167]: X-User-Id: 1d60ce27bfad4d7c9b976e834df35ad4 Apr 11 15:39:39 user devstack@n-api.service[61167]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member Apr 11 15:39:39 user devstack@n-api.service[61167]: method: > Apr 11 15:39:39 user devstack@n-api.service[61167]: exception: Instance 7c4329ae-07cb-4f28-9fd6-29b398517d2b could not be found. Apr 11 15:39:39 user devstack@n-api.service[61167]: action_args: {'id': '7c4329ae-07cb-4f28-9fd6-29b398517d2b'} Apr 11 15:39:39 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c4329ae-07cb-4f28-9fd6-29b398517d2b could not be found. Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c4329ae-07cb-4f28-9fd6-29b398517d2b could not be found. Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c4329ae-07cb-4f28-9fd6-29b398517d2b could not be found. Apr 11 15:39:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:39:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-4d4b7a40-e09b-4afe-9d2c-40792035aae6 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Returning 404 to user: Instance 7c4329ae-07cb-4f28-9fd6-29b398517d2b could not be found. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:39:39 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-4d4b7a40-e09b-4afe-9d2c-40792035aae6 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c4329ae-07cb-4f28-9fd6-29b398517d2b" status: 404 len: 111 microversion: 2.87 time: 0.032447 Apr 11 15:39:39 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 240/711] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:39:39 2023] GET /compute/v2.1/servers/7c4329ae-07cb-4f28-9fd6-29b398517d2b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 15:39:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:39:39 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:39:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:39 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Going to try to terminate instance {{(pid=61166) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:39:40 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b0d90fd2-6a95-43c4-8756-e82071d99154" status: 204 len: 0 microversion: 2.87 time: 0.119213 Apr 11 15:39:40 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 237/712] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 15:39:39 2023] DELETE /compute/v2.1/servers/b0d90fd2-6a95-43c4-8756-e82071d99154 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 15:39:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-594e7e37-0c55-4fa1-a3d4-f9494d1c5fe4 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:39:40 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-594e7e37-0c55-4fa1-a3d4-f9494d1c5fe4 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:39:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-594e7e37-0c55-4fa1-a3d4-f9494d1c5fe4 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-594e7e37-0c55-4fa1-a3d4-f9494d1c5fe4 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-594e7e37-0c55-4fa1-a3d4-f9494d1c5fe4 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-594e7e37-0c55-4fa1-a3d4-f9494d1c5fe4 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-594e7e37-0c55-4fa1-a3d4-f9494d1c5fe4 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-594e7e37-0c55-4fa1-a3d4-f9494d1c5fe4 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:40 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-594e7e37-0c55-4fa1-a3d4-f9494d1c5fe4 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:39:40 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-594e7e37-0c55-4fa1-a3d4-f9494d1c5fe4 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:39:40 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-594e7e37-0c55-4fa1-a3d4-f9494d1c5fe4 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:39:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-7acd6701-2ba4-42b0-b864-91f04cb5d778 req-fc98ec01-e013-4a27-9eed-a75a6d730985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d90fd2-6a95-43c4-8756-e82071d99154", "name": "network-vif-unplugged", "status": "completed", "tag": "4718fa68-0eb9-4592-8c43-981438e3d0b8"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:39:40 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-594e7e37-0c55-4fa1-a3d4-f9494d1c5fe4 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0d90fd2-6a95-43c4-8756-e82071d99154" status: 200 len: 1774 microversion: 2.87 time: 0.229768 Apr 11 15:39:40 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 236/713] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:39:40 2023] GET /compute/v2.1/servers/b0d90fd2-6a95-43c4-8756-e82071d99154 => generated 1774 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 15:39:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-7acd6701-2ba4-42b0-b864-91f04cb5d778 req-fc98ec01-e013-4a27-9eed-a75a6d730985 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-7acd6701-2ba4-42b0-b864-91f04cb5d778 req-fc98ec01-e013-4a27-9eed-a75a6d730985 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-7acd6701-2ba4-42b0-b864-91f04cb5d778 req-fc98ec01-e013-4a27-9eed-a75a6d730985 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:40 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-7acd6701-2ba4-42b0-b864-91f04cb5d778 req-fc98ec01-e013-4a27-9eed-a75a6d730985 service nova] Creating event network-vif-unplugged:4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance b0d90fd2-6a95-43c4-8756-e82071d99154 on user Apr 11 15:39:40 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-7acd6701-2ba4-42b0-b864-91f04cb5d778 req-fc98ec01-e013-4a27-9eed-a75a6d730985 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038167 Apr 11 15:39:40 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 241/714] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:39:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:39:42 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-8b81022c-7ba7-4ec8-bccf-853d75925eaf req-67e1d5b1-bb5f-49b7-b744-dbeb25f82944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d90fd2-6a95-43c4-8756-e82071d99154", "name": "network-vif-plugged", "status": "completed", "tag": "4718fa68-0eb9-4592-8c43-981438e3d0b8"}, {"server_uuid": "b0d90fd2-6a95-43c4-8756-e82071d99154", "name": "network-vif-deleted", "tag": "4718fa68-0eb9-4592-8c43-981438e3d0b8"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:39:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-8b81022c-7ba7-4ec8-bccf-853d75925eaf req-67e1d5b1-bb5f-49b7-b744-dbeb25f82944 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:39:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-8b81022c-7ba7-4ec8-bccf-853d75925eaf req-67e1d5b1-bb5f-49b7-b744-dbeb25f82944 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:39:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-8b81022c-7ba7-4ec8-bccf-853d75925eaf req-67e1d5b1-bb5f-49b7-b744-dbeb25f82944 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:39:42 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-8b81022c-7ba7-4ec8-bccf-853d75925eaf req-67e1d5b1-bb5f-49b7-b744-dbeb25f82944 service nova] Creating event network-vif-plugged:4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance b0d90fd2-6a95-43c4-8756-e82071d99154 on user Apr 11 15:39:42 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-8b81022c-7ba7-4ec8-bccf-853d75925eaf req-67e1d5b1-bb5f-49b7-b744-dbeb25f82944 service nova] Creating event network-vif-deleted:4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance b0d90fd2-6a95-43c4-8756-e82071d99154 on user Apr 11 15:39:42 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-8b81022c-7ba7-4ec8-bccf-853d75925eaf req-67e1d5b1-bb5f-49b7-b744-dbeb25f82944 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033821 Apr 11 15:39:42 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 238/715] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:39:42 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:40:00 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=14 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:40:00 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=8 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:40:00 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-2d14384c-119b-4a8c-89d2-1101f469f30d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:40:00 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-2d14384c-119b-4a8c-89d2-1101f469f30d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:40:00 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-2d14384c-119b-4a8c-89d2-1101f469f30d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:40:00 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-2d14384c-119b-4a8c-89d2-1101f469f30d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:40:00 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-2d14384c-119b-4a8c-89d2-1101f469f30d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:40:00 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-2d14384c-119b-4a8c-89d2-1101f469f30d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:40:00 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-2d14384c-119b-4a8c-89d2-1101f469f30d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:40:00 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-2d14384c-119b-4a8c-89d2-1101f469f30d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:40:00 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-2d14384c-119b-4a8c-89d2-1101f469f30d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:40:00 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-2d14384c-119b-4a8c-89d2-1101f469f30d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4" status: 200 len: 1554 microversion: 2.1 time: 0.143390 Apr 11 15:40:00 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 237/716] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:40:00 2023] GET /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4 => generated 1554 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:40:29 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=8 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:40:29 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=12 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:40:29 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-aa3bae61-f22c-44af-9d65-d6a02acf4a81 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:40:29 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-aa3bae61-f22c-44af-9d65-d6a02acf4a81 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:40:29 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-aa3bae61-f22c-44af-9d65-d6a02acf4a81 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:40:29 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-aa3bae61-f22c-44af-9d65-d6a02acf4a81 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:40:29 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-aa3bae61-f22c-44af-9d65-d6a02acf4a81 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:40:29 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-aa3bae61-f22c-44af-9d65-d6a02acf4a81 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:40:29 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-aa3bae61-f22c-44af-9d65-d6a02acf4a81 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:40:29 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-aa3bae61-f22c-44af-9d65-d6a02acf4a81 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:40:29 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-aa3bae61-f22c-44af-9d65-d6a02acf4a81 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048947 Apr 11 15:40:29 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 242/717] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:40:29 2023] GET /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 15:40:29 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:40:29 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=30,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:40:29 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-cd279623-d208-4dfb-be51-346d133fb229 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:40:29 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-cd279623-d208-4dfb-be51-346d133fb229 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:40:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-cd279623-d208-4dfb-be51-346d133fb229 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:40:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-cd279623-d208-4dfb-be51-346d133fb229 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:40:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-cd279623-d208-4dfb-be51-346d133fb229 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:40:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-cd279623-d208-4dfb-be51-346d133fb229 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:40:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-cd279623-d208-4dfb-be51-346d133fb229 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:40:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-cd279623-d208-4dfb-be51-346d133fb229 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:40:29 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-cd279623-d208-4dfb-be51-346d133fb229 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] HTTP exception thrown: Instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 is not attached to volume 6119ec74-db79-4b19-9bf7-44cc8a4d853a Apr 11 15:40:29 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-cd279623-d208-4dfb-be51-346d133fb229 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Request method failure captured: Apr 11 15:40:29 user devstack@n-api.service[61166]: request: DELETE /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/os-volume_attachments/6119ec74-db79-4b19-9bf7-44cc8a4d853a HTTP/1.1 Apr 11 15:40:29 user devstack@n-api.service[61166]: Accept: application/json Apr 11 15:40:29 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 15:40:29 user devstack@n-api.service[61166]: Connection: close Apr 11 15:40:29 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 15:40:29 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 15:40:29 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 15:40:29 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 15:40:29 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 15:40:29 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNX5BcTshUbhWFRlg8t_zz9-lO37xLS5_qPcHcMwZTMQwRt4-or551ovVhKCAIBaCeMNrORffTlZsBlQimdDmzpIuoYxvEBmKfToUDowo0nTS3d21BIn-SO-2Yx-r5ng4wKQzH6UThKxvWXMHzNTatOGJbb71hvxv9ohtGR1eUXPnvUI Apr 11 15:40:29 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 15:40:29 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 15:40:29 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 15:40:29 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 15:40:29 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 15:40:29 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 15:40:29 user devstack@n-api.service[61166]: X-Project-Id: c23461a3d7ca49f6a77d3fde6f1009d3 Apr 11 15:40:29 user devstack@n-api.service[61166]: X-Project-Name: tempest-TestMinimumBasicScenario-673773229 Apr 11 15:40:29 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 15:40:29 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 15:40:29 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c23461a3d7ca49f6a77d3fde6f1009d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c23461a3d7ca49f6a77d3fde6f1009d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c23461a3d7ca49f6a77d3fde6f1009d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:40:29 user devstack@n-api.service[61166]: X-Tenant: tempest-TestMinimumBasicScenario-673773229 Apr 11 15:40:29 user devstack@n-api.service[61166]: X-Tenant-Id: c23461a3d7ca49f6a77d3fde6f1009d3 Apr 11 15:40:29 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-TestMinimumBasicScenario-673773229 Apr 11 15:40:29 user devstack@n-api.service[61166]: X-User: tempest-TestMinimumBasicScenario-673773229-project-member Apr 11 15:40:29 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 15:40:29 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 15:40:29 user devstack@n-api.service[61166]: X-User-Id: 044f17aee3324b3a97bebe935548b3b4 Apr 11 15:40:29 user devstack@n-api.service[61166]: X-User-Name: tempest-TestMinimumBasicScenario-673773229-project-member Apr 11 15:40:29 user devstack@n-api.service[61166]: method: > Apr 11 15:40:29 user devstack@n-api.service[61166]: exception: Instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 is not attached to volume 6119ec74-db79-4b19-9bf7-44cc8a4d853a Apr 11 15:40:29 user devstack@n-api.service[61166]: action_args: {'server_id': '1e3d0956-d528-4097-a200-d9b2b6ce7aa8', 'id': '6119ec74-db79-4b19-9bf7-44cc8a4d853a'} Apr 11 15:40:29 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:40:29 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:40:29 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 11 15:40:29 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 11 15:40:29 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 11 15:40:29 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 11 15:40:29 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 11 15:40:29 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 11 15:40:29 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6119ec74-db79-4b19-9bf7-44cc8a4d853a. Apr 11 15:40:29 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:40:29 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:40:29 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:40:29 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:40:29 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:40:29 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:40:29 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:40:29 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:40:29 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:40:29 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:40:29 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 11 15:40:29 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 11 15:40:29 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 is not attached to volume 6119ec74-db79-4b19-9bf7-44cc8a4d853a Apr 11 15:40:29 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:40:29 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:40:29 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:40:29 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:40:29 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:40:29 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:40:29 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:40:29 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:40:29 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 is not attached to volume 6119ec74-db79-4b19-9bf7-44cc8a4d853a Apr 11 15:40:29 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:40:29 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-cd279623-d208-4dfb-be51-346d133fb229 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Returning 404 to user: Instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 is not attached to volume 6119ec74-db79-4b19-9bf7-44cc8a4d853a {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:40:29 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-cd279623-d208-4dfb-be51-346d133fb229 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/os-volume_attachments/6119ec74-db79-4b19-9bf7-44cc8a4d853a" status: 404 len: 154 microversion: 2.1 time: 0.174871 Apr 11 15:40:29 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 239/718] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 15:40:29 2023] DELETE /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/os-volume_attachments/6119ec74-db79-4b19-9bf7-44cc8a4d853a => generated 154 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:40:30 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:40:30 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:40:30 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-621548ec-b1df-433c-b45a-5336ef22da57 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:40:30 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-621548ec-b1df-433c-b45a-5336ef22da57 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:40:30 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-621548ec-b1df-433c-b45a-5336ef22da57 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:40:30 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-621548ec-b1df-433c-b45a-5336ef22da57 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:40:30 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-621548ec-b1df-433c-b45a-5336ef22da57 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:40:30 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-621548ec-b1df-433c-b45a-5336ef22da57 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:40:30 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-621548ec-b1df-433c-b45a-5336ef22da57 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:40:30 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-621548ec-b1df-433c-b45a-5336ef22da57 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:40:30 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-621548ec-b1df-433c-b45a-5336ef22da57 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] HTTP exception thrown: Instance b0d90fd2-6a95-43c4-8756-e82071d99154 could not be found. Apr 11 15:40:30 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-621548ec-b1df-433c-b45a-5336ef22da57 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Request method failure captured: Apr 11 15:40:30 user devstack@n-api.service[61165]: request: GET /compute/v2.1/servers/b0d90fd2-6a95-43c4-8756-e82071d99154 HTTP/1.1 Apr 11 15:40:30 user devstack@n-api.service[61165]: Accept: application/json Apr 11 15:40:30 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 15:40:30 user devstack@n-api.service[61165]: Connection: close Apr 11 15:40:30 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 15:40:30 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 15:40:30 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 15:40:30 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 15:40:30 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 15:40:30 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNXrTxmYoUPbA1Vrii2KAgpzDULSyiL1qGl8ysTTiP7FHcjwwJ2tMcOq2-bqdklTWlpKEHoEklslzx7mAtK1aZZWTMLRybETvT8MXnGulH_rR9jL3ju6Sx2nCkQ6LJJ70mflSFhe1N0Vreir0B8yLa_h-LXbwY6x21c0oDG6hH50MHM8 Apr 11 15:40:30 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 15:40:30 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 15:40:30 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 15:40:30 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 15:40:30 user devstack@n-api.service[61165]: X-Openstack-Nova-Api-Version: 2.87 Apr 11 15:40:30 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 15:40:30 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 15:40:30 user devstack@n-api.service[61165]: X-Project-Id: ddc05e9bf5ab426982ccb3092ad596e4 Apr 11 15:40:30 user devstack@n-api.service[61165]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1907753459 Apr 11 15:40:30 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 15:40:30 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 15:40:30 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ddc05e9bf5ab426982ccb3092ad596e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ddc05e9bf5ab426982ccb3092ad596e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ddc05e9bf5ab426982ccb3092ad596e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:40:30 user devstack@n-api.service[61165]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1907753459 Apr 11 15:40:30 user devstack@n-api.service[61165]: X-Tenant-Id: ddc05e9bf5ab426982ccb3092ad596e4 Apr 11 15:40:30 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1907753459 Apr 11 15:40:30 user devstack@n-api.service[61165]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member Apr 11 15:40:30 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 15:40:30 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 15:40:30 user devstack@n-api.service[61165]: X-User-Id: 1d60ce27bfad4d7c9b976e834df35ad4 Apr 11 15:40:30 user devstack@n-api.service[61165]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member Apr 11 15:40:30 user devstack@n-api.service[61165]: method: > Apr 11 15:40:30 user devstack@n-api.service[61165]: exception: Instance b0d90fd2-6a95-43c4-8756-e82071d99154 could not be found. Apr 11 15:40:30 user devstack@n-api.service[61165]: action_args: {'id': 'b0d90fd2-6a95-43c4-8756-e82071d99154'} Apr 11 15:40:30 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0d90fd2-6a95-43c4-8756-e82071d99154 could not be found. Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0d90fd2-6a95-43c4-8756-e82071d99154 could not be found. Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0d90fd2-6a95-43c4-8756-e82071d99154 could not be found. Apr 11 15:40:30 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:40:30 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-621548ec-b1df-433c-b45a-5336ef22da57 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Returning 404 to user: Instance b0d90fd2-6a95-43c4-8756-e82071d99154 could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:40:30 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-621548ec-b1df-433c-b45a-5336ef22da57 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0d90fd2-6a95-43c4-8756-e82071d99154" status: 404 len: 111 microversion: 2.87 time: 0.038725 Apr 11 15:40:30 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 238/719] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:40:30 2023] GET /compute/v2.1/servers/b0d90fd2-6a95-43c4-8756-e82071d99154 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 15:40:30 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:40:30 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:40:30 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:40:30 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:40:30 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:40:30 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:40:30 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:40:30 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:40:30 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Going to try to terminate instance {{(pid=61167) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:40:30 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/de1a45fd-27be-4438-80a4-2f3a100643c9" status: 204 len: 0 microversion: 2.87 time: 0.121700 Apr 11 15:40:30 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 243/720] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 15:40:30 2023] DELETE /compute/v2.1/servers/de1a45fd-27be-4438-80a4-2f3a100643c9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 15:40:30 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-8061b4a7-a8ca-463d-90fc-950e4b61cb6a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:40:30 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-8061b4a7-a8ca-463d-90fc-950e4b61cb6a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:40:30 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8061b4a7-a8ca-463d-90fc-950e4b61cb6a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:40:30 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8061b4a7-a8ca-463d-90fc-950e4b61cb6a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:40:30 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8061b4a7-a8ca-463d-90fc-950e4b61cb6a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:40:30 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8061b4a7-a8ca-463d-90fc-950e4b61cb6a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:40:30 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8061b4a7-a8ca-463d-90fc-950e4b61cb6a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:40:30 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8061b4a7-a8ca-463d-90fc-950e4b61cb6a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:40:30 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:40:30 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:40:30 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:40:30 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:40:30 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:40:30 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:40:30 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:40:30 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:40:30 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-8061b4a7-a8ca-463d-90fc-950e4b61cb6a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:40:30 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-8061b4a7-a8ca-463d-90fc-950e4b61cb6a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:40:30 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-8061b4a7-a8ca-463d-90fc-950e4b61cb6a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:40:30 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-8061b4a7-a8ca-463d-90fc-950e4b61cb6a tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de1a45fd-27be-4438-80a4-2f3a100643c9" status: 200 len: 1696 microversion: 2.87 time: 0.186241 Apr 11 15:40:30 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 240/721] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:40:30 2023] GET /compute/v2.1/servers/de1a45fd-27be-4438-80a4-2f3a100643c9 => generated 1696 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 15:40:30 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-6e49cc92-fae6-4e2a-8a8b-e233786e229d req-9be6239c-5ed8-433c-8957-356b86b551c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de1a45fd-27be-4438-80a4-2f3a100643c9", "name": "network-vif-unplugged", "status": "completed", "tag": "197ae974-459a-49ab-9d70-89bfaa073f50"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:40:30 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-6e49cc92-fae6-4e2a-8a8b-e233786e229d req-9be6239c-5ed8-433c-8957-356b86b551c0 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:40:30 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-6e49cc92-fae6-4e2a-8a8b-e233786e229d req-9be6239c-5ed8-433c-8957-356b86b551c0 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:40:30 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-6e49cc92-fae6-4e2a-8a8b-e233786e229d req-9be6239c-5ed8-433c-8957-356b86b551c0 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:40:30 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-6e49cc92-fae6-4e2a-8a8b-e233786e229d req-9be6239c-5ed8-433c-8957-356b86b551c0 service nova] Creating event network-vif-unplugged:197ae974-459a-49ab-9d70-89bfaa073f50 for instance de1a45fd-27be-4438-80a4-2f3a100643c9 on user Apr 11 15:40:30 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-6e49cc92-fae6-4e2a-8a8b-e233786e229d req-9be6239c-5ed8-433c-8957-356b86b551c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030204 Apr 11 15:40:30 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 244/722] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:40:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:40:31 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Going to try to terminate instance {{(pid=61165) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:40:31 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8" status: 204 len: 0 microversion: 2.1 time: 0.416003 Apr 11 15:40:31 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 239/723] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:40:30 2023] DELETE /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 11 15:40:31 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-e65d38b5-0e81-46c2-bede-1fa71e796d4d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:40:31 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-e65d38b5-0e81-46c2-bede-1fa71e796d4d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:40:31 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e65d38b5-0e81-46c2-bede-1fa71e796d4d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:40:31 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e65d38b5-0e81-46c2-bede-1fa71e796d4d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:40:31 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e65d38b5-0e81-46c2-bede-1fa71e796d4d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:40:31 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e65d38b5-0e81-46c2-bede-1fa71e796d4d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:40:31 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e65d38b5-0e81-46c2-bede-1fa71e796d4d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:40:31 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e65d38b5-0e81-46c2-bede-1fa71e796d4d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:40:31 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-e65d38b5-0e81-46c2-bede-1fa71e796d4d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044f17aee3324b3a97bebe935548b3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23461a3d7ca49f6a77d3fde6f1009d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:40:31 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-e65d38b5-0e81-46c2-bede-1fa71e796d4d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8" status: 200 len: 1543 microversion: 2.1 time: 0.163938 Apr 11 15:40:31 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 241/724] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:40:31 2023] GET /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8 => generated 1543 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:40:31 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-2cd98944-9eaa-4ca0-84b0-b9c57c09c34f req-d148e4e0-bcf1-455f-abc5-689b9ba735e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e3d0956-d528-4097-a200-d9b2b6ce7aa8", "name": "network-vif-unplugged", "status": "completed", "tag": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:40:31 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-2cd98944-9eaa-4ca0-84b0-b9c57c09c34f req-d148e4e0-bcf1-455f-abc5-689b9ba735e8 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:40:31 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-2cd98944-9eaa-4ca0-84b0-b9c57c09c34f req-d148e4e0-bcf1-455f-abc5-689b9ba735e8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:40:31 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-2cd98944-9eaa-4ca0-84b0-b9c57c09c34f req-d148e4e0-bcf1-455f-abc5-689b9ba735e8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:40:31 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-2cd98944-9eaa-4ca0-84b0-b9c57c09c34f req-d148e4e0-bcf1-455f-abc5-689b9ba735e8 service nova] Creating event network-vif-unplugged:19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 for instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 on user Apr 11 15:40:31 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-2cd98944-9eaa-4ca0-84b0-b9c57c09c34f req-d148e4e0-bcf1-455f-abc5-689b9ba735e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031719 Apr 11 15:40:31 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 245/725] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:40:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:40:32 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-7e14d949-987e-4adc-b111-9085a67bd1f7 req-8a02ce6f-3b76-47ae-a739-dcb41b0dfe74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de1a45fd-27be-4438-80a4-2f3a100643c9", "name": "network-vif-plugged", "status": "completed", "tag": "197ae974-459a-49ab-9d70-89bfaa073f50"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:40:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-7e14d949-987e-4adc-b111-9085a67bd1f7 req-8a02ce6f-3b76-47ae-a739-dcb41b0dfe74 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:40:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-7e14d949-987e-4adc-b111-9085a67bd1f7 req-8a02ce6f-3b76-47ae-a739-dcb41b0dfe74 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:40:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-7e14d949-987e-4adc-b111-9085a67bd1f7 req-8a02ce6f-3b76-47ae-a739-dcb41b0dfe74 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:40:33 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-7e14d949-987e-4adc-b111-9085a67bd1f7 req-8a02ce6f-3b76-47ae-a739-dcb41b0dfe74 service nova] Creating event network-vif-plugged:197ae974-459a-49ab-9d70-89bfaa073f50 for instance de1a45fd-27be-4438-80a4-2f3a100643c9 on user Apr 11 15:40:33 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-7e14d949-987e-4adc-b111-9085a67bd1f7 req-8a02ce6f-3b76-47ae-a739-dcb41b0dfe74 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031437 Apr 11 15:40:33 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 240/726] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:40:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 15:40:33 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-032e60ba-7cd3-45dd-8b53-51c685dfb025 req-fcd161ea-3dab-4969-a20b-cdd9a1d3718f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e3d0956-d528-4097-a200-d9b2b6ce7aa8", "name": "network-vif-plugged", "status": "completed", "tag": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53"}, {"server_uuid": "de1a45fd-27be-4438-80a4-2f3a100643c9", "name": "network-vif-deleted", "tag": "197ae974-459a-49ab-9d70-89bfaa073f50"}, {"server_uuid": "1e3d0956-d528-4097-a200-d9b2b6ce7aa8", "name": "network-vif-deleted", "tag": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:40:33 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-032e60ba-7cd3-45dd-8b53-51c685dfb025 req-fcd161ea-3dab-4969-a20b-cdd9a1d3718f service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:40:33 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-032e60ba-7cd3-45dd-8b53-51c685dfb025 req-fcd161ea-3dab-4969-a20b-cdd9a1d3718f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:40:33 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-032e60ba-7cd3-45dd-8b53-51c685dfb025 req-fcd161ea-3dab-4969-a20b-cdd9a1d3718f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:40:33 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-032e60ba-7cd3-45dd-8b53-51c685dfb025 req-fcd161ea-3dab-4969-a20b-cdd9a1d3718f service nova] Creating event network-vif-plugged:19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 for instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 on user Apr 11 15:40:33 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-032e60ba-7cd3-45dd-8b53-51c685dfb025 req-fcd161ea-3dab-4969-a20b-cdd9a1d3718f service nova] Creating event network-vif-deleted:197ae974-459a-49ab-9d70-89bfaa073f50 for instance de1a45fd-27be-4438-80a4-2f3a100643c9 on user Apr 11 15:40:33 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-032e60ba-7cd3-45dd-8b53-51c685dfb025 req-fcd161ea-3dab-4969-a20b-cdd9a1d3718f service nova] Creating event network-vif-deleted:19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 for instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 on user Apr 11 15:40:33 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-032e60ba-7cd3-45dd-8b53-51c685dfb025 req-fcd161ea-3dab-4969-a20b-cdd9a1d3718f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.033917 Apr 11 15:40:33 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 242/727] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:40:33 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:40:35 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:40:35 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:40:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:40:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:40:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:40:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:40:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:40:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:40:35 user devstack@n-api.service[61167]: DEBUG nova.objects.instance [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'flavor' on Instance uuid 6f6ae64a-c760-4ba3-8a50-d380835d9913 {{(pid=61167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 15:40:35 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6f6ae64a-c760-4ba3-8a50-d380835d9913/action" status: 200 len: 32 microversion: 2.1 time: 0.097495 Apr 11 15:40:35 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 246/728] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 15:40:35 2023] POST /compute/v2.1/servers/6f6ae64a-c760-4ba3-8a50-d380835d9913/action => generated 32 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 15:40:35 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-f3894666-f530-4558-8cf2-1849fb63cfc5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:40:35 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-f3894666-f530-4558-8cf2-1849fb63cfc5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:40:35 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-f3894666-f530-4558-8cf2-1849fb63cfc5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:40:35 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-f3894666-f530-4558-8cf2-1849fb63cfc5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:40:35 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-f3894666-f530-4558-8cf2-1849fb63cfc5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:40:35 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-f3894666-f530-4558-8cf2-1849fb63cfc5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:40:35 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-f3894666-f530-4558-8cf2-1849fb63cfc5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:40:35 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-f3894666-f530-4558-8cf2-1849fb63cfc5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:40:35 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-f3894666-f530-4558-8cf2-1849fb63cfc5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8492f96e5d4f54aaae3679c82b6759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd700a53aa25849e0afd562b05881d09a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:40:35 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-f3894666-f530-4558-8cf2-1849fb63cfc5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f6ae64a-c760-4ba3-8a50-d380835d9913" status: 200 len: 1511 microversion: 2.1 time: 0.149227 Apr 11 15:40:35 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 241/729] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:40:35 2023] GET /compute/v2.1/servers/6f6ae64a-c760-4ba3-8a50-d380835d9913 => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:40:36 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-8cb50e40-1ecf-4f4a-8feb-fdecf33dfe28 req-4e93f559-46fb-4b22-9761-14e70a6c043f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f6ae64a-c760-4ba3-8a50-d380835d9913", "name": "network-vif-unplugged", "status": "completed", "tag": "2b891eeb-973f-492a-9059-55961bb956bf"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:40:36 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-8cb50e40-1ecf-4f4a-8feb-fdecf33dfe28 req-4e93f559-46fb-4b22-9761-14e70a6c043f service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:40:36 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-8cb50e40-1ecf-4f4a-8feb-fdecf33dfe28 req-4e93f559-46fb-4b22-9761-14e70a6c043f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:40:36 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-8cb50e40-1ecf-4f4a-8feb-fdecf33dfe28 req-4e93f559-46fb-4b22-9761-14e70a6c043f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:40:36 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-8cb50e40-1ecf-4f4a-8feb-fdecf33dfe28 req-4e93f559-46fb-4b22-9761-14e70a6c043f service nova] Creating event network-vif-unplugged:2b891eeb-973f-492a-9059-55961bb956bf for instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 on user Apr 11 15:40:36 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-8cb50e40-1ecf-4f4a-8feb-fdecf33dfe28 req-4e93f559-46fb-4b22-9761-14e70a6c043f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032116 Apr 11 15:40:36 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 243/730] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:40:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:40:38 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f6ae64a-c760-4ba3-8a50-d380835d9913", "name": "network-vif-plugged", "status": "completed", "tag": "2b891eeb-973f-492a-9059-55961bb956bf"}, {"server_uuid": "6f6ae64a-c760-4ba3-8a50-d380835d9913", "name": "network-vif-plugged", "status": "completed", "tag": "2b891eeb-973f-492a-9059-55961bb956bf"}, {"server_uuid": "6f6ae64a-c760-4ba3-8a50-d380835d9913", "name": "network-vif-plugged", "status": "completed", "tag": "2b891eeb-973f-492a-9059-55961bb956bf"}, {"server_uuid": "6f6ae64a-c760-4ba3-8a50-d380835d9913", "name": "network-vif-unplugged", "status": "completed", "tag": "2b891eeb-973f-492a-9059-55961bb956bf"}, {"server_uuid": "6f6ae64a-c760-4ba3-8a50-d380835d9913", "name": "network-vif-plugged", "status": "completed", "tag": "2b891eeb-973f-492a-9059-55961bb956bf"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:40:38 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:40:38 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:40:38 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:40:38 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] Creating event network-vif-plugged:2b891eeb-973f-492a-9059-55961bb956bf for instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 on user Apr 11 15:40:38 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] Creating event network-vif-plugged:2b891eeb-973f-492a-9059-55961bb956bf for instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 on user Apr 11 15:40:38 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] Creating event network-vif-plugged:2b891eeb-973f-492a-9059-55961bb956bf for instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 on user Apr 11 15:40:38 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] Creating event network-vif-unplugged:2b891eeb-973f-492a-9059-55961bb956bf for instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 on user Apr 11 15:40:38 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] Creating event network-vif-plugged:2b891eeb-973f-492a-9059-55961bb956bf for instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 on user Apr 11 15:40:38 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.030781 Apr 11 15:40:38 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 247/731] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:40:38 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:40:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-4dd05e25-a488-443f-9c55-e505abbf0eea req-3aa1b89e-8193-4376-b8fd-b16223f5d1ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f6ae64a-c760-4ba3-8a50-d380835d9913", "name": "network-vif-plugged", "status": "completed", "tag": "2b891eeb-973f-492a-9059-55961bb956bf"}, {"server_uuid": "6f6ae64a-c760-4ba3-8a50-d380835d9913", "name": "network-vif-plugged", "status": "completed", "tag": "2b891eeb-973f-492a-9059-55961bb956bf"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:40:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-4dd05e25-a488-443f-9c55-e505abbf0eea req-3aa1b89e-8193-4376-b8fd-b16223f5d1ab service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:40:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-4dd05e25-a488-443f-9c55-e505abbf0eea req-3aa1b89e-8193-4376-b8fd-b16223f5d1ab service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:40:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-4dd05e25-a488-443f-9c55-e505abbf0eea req-3aa1b89e-8193-4376-b8fd-b16223f5d1ab service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:40:40 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-4dd05e25-a488-443f-9c55-e505abbf0eea req-3aa1b89e-8193-4376-b8fd-b16223f5d1ab service nova] Creating event network-vif-plugged:2b891eeb-973f-492a-9059-55961bb956bf for instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 on user Apr 11 15:40:40 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-4dd05e25-a488-443f-9c55-e505abbf0eea req-3aa1b89e-8193-4376-b8fd-b16223f5d1ab service nova] Creating event network-vif-plugged:2b891eeb-973f-492a-9059-55961bb956bf for instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 on user Apr 11 15:40:40 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-4dd05e25-a488-443f-9c55-e505abbf0eea req-3aa1b89e-8193-4376-b8fd-b16223f5d1ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029496 Apr 11 15:40:40 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 242/732] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:40:40 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:41:00 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=12 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:41:00 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=22 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:41:00 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-e752e989-7612-4ca6-a088-443658688663 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:41:00 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-e752e989-7612-4ca6-a088-443658688663 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:41:00 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e752e989-7612-4ca6-a088-443658688663 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:41:00 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e752e989-7612-4ca6-a088-443658688663 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:41:00 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e752e989-7612-4ca6-a088-443658688663 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:41:00 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e752e989-7612-4ca6-a088-443658688663 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:41:00 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e752e989-7612-4ca6-a088-443658688663 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:41:00 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e752e989-7612-4ca6-a088-443658688663 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:41:00 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-e752e989-7612-4ca6-a088-443658688663 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4/action" status: 204 len: 0 microversion: 2.1 time: 0.087409 Apr 11 15:41:00 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 244/733] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 15:41:00 2023] POST /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4/action => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:41:00 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:41:00 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:41:00 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-a851f795-4f3a-4072-92e0-f93d79299b00 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:41:00 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-a851f795-4f3a-4072-92e0-f93d79299b00 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:41:00 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-a851f795-4f3a-4072-92e0-f93d79299b00 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:41:00 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-a851f795-4f3a-4072-92e0-f93d79299b00 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:41:00 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-a851f795-4f3a-4072-92e0-f93d79299b00 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:41:00 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-a851f795-4f3a-4072-92e0-f93d79299b00 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:41:00 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-a851f795-4f3a-4072-92e0-f93d79299b00 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:41:00 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-a851f795-4f3a-4072-92e0-f93d79299b00 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:41:01 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-a851f795-4f3a-4072-92e0-f93d79299b00 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:41:01 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-a851f795-4f3a-4072-92e0-f93d79299b00 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4" status: 200 len: 1554 microversion: 2.1 time: 0.177940 Apr 11 15:41:01 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 248/734] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:41:00 2023] GET /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4 => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:41:20 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-d4a16cda-6fbf-4b52-993f-a258b272f396 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:41:20 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-d4a16cda-6fbf-4b52-993f-a258b272f396 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:41:20 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:41:20 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:41:20 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d4a16cda-6fbf-4b52-993f-a258b272f396 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:41:20 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d4a16cda-6fbf-4b52-993f-a258b272f396 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:41:20 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d4a16cda-6fbf-4b52-993f-a258b272f396 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:41:20 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d4a16cda-6fbf-4b52-993f-a258b272f396 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:41:20 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d4a16cda-6fbf-4b52-993f-a258b272f396 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:41:20 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d4a16cda-6fbf-4b52-993f-a258b272f396 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:41:21 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-d4a16cda-6fbf-4b52-993f-a258b272f396 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] HTTP exception thrown: Instance de1a45fd-27be-4438-80a4-2f3a100643c9 could not be found. Apr 11 15:41:21 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-d4a16cda-6fbf-4b52-993f-a258b272f396 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Request method failure captured: Apr 11 15:41:21 user devstack@n-api.service[61165]: request: GET /compute/v2.1/servers/de1a45fd-27be-4438-80a4-2f3a100643c9 HTTP/1.1 Apr 11 15:41:21 user devstack@n-api.service[61165]: Accept: application/json Apr 11 15:41:21 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 15:41:21 user devstack@n-api.service[61165]: Connection: close Apr 11 15:41:21 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 15:41:21 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 15:41:21 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 15:41:21 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 15:41:21 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 15:41:21 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNXrTxmYoUPbA1Vrii2KAgpzDULSyiL1qGl8ysTTiP7FHcjwwJ2tMcOq2-bqdklTWlpKEHoEklslzx7mAtK1aZZWTMLRybETvT8MXnGulH_rR9jL3ju6Sx2nCkQ6LJJ70mflSFhe1N0Vreir0B8yLa_h-LXbwY6x21c0oDG6hH50MHM8 Apr 11 15:41:21 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 15:41:21 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 15:41:21 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 15:41:21 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 15:41:21 user devstack@n-api.service[61165]: X-Openstack-Nova-Api-Version: 2.87 Apr 11 15:41:21 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 15:41:21 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 15:41:21 user devstack@n-api.service[61165]: X-Project-Id: ddc05e9bf5ab426982ccb3092ad596e4 Apr 11 15:41:21 user devstack@n-api.service[61165]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1907753459 Apr 11 15:41:21 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 15:41:21 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 15:41:21 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ddc05e9bf5ab426982ccb3092ad596e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ddc05e9bf5ab426982ccb3092ad596e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ddc05e9bf5ab426982ccb3092ad596e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:41:21 user devstack@n-api.service[61165]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1907753459 Apr 11 15:41:21 user devstack@n-api.service[61165]: X-Tenant-Id: ddc05e9bf5ab426982ccb3092ad596e4 Apr 11 15:41:21 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1907753459 Apr 11 15:41:21 user devstack@n-api.service[61165]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member Apr 11 15:41:21 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 15:41:21 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 15:41:21 user devstack@n-api.service[61165]: X-User-Id: 1d60ce27bfad4d7c9b976e834df35ad4 Apr 11 15:41:21 user devstack@n-api.service[61165]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member Apr 11 15:41:21 user devstack@n-api.service[61165]: method: > Apr 11 15:41:21 user devstack@n-api.service[61165]: exception: Instance de1a45fd-27be-4438-80a4-2f3a100643c9 could not be found. Apr 11 15:41:21 user devstack@n-api.service[61165]: action_args: {'id': 'de1a45fd-27be-4438-80a4-2f3a100643c9'} Apr 11 15:41:21 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de1a45fd-27be-4438-80a4-2f3a100643c9 could not be found. Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de1a45fd-27be-4438-80a4-2f3a100643c9 could not be found. Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de1a45fd-27be-4438-80a4-2f3a100643c9 could not be found. Apr 11 15:41:21 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:41:21 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-d4a16cda-6fbf-4b52-993f-a258b272f396 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Returning 404 to user: Instance de1a45fd-27be-4438-80a4-2f3a100643c9 could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:41:21 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-d4a16cda-6fbf-4b52-993f-a258b272f396 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de1a45fd-27be-4438-80a4-2f3a100643c9" status: 404 len: 111 microversion: 2.87 time: 0.041388 Apr 11 15:41:21 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 243/735] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 15:41:20 2023] GET /compute/v2.1/servers/de1a45fd-27be-4438-80a4-2f3a100643c9 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 15:41:21 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:41:21 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:41:21 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-bdcc4907-6283-468f-af02-49896a68aef8 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:41:21 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-bdcc4907-6283-468f-af02-49896a68aef8 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:41:21 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-bdcc4907-6283-468f-af02-49896a68aef8 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:41:21 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-bdcc4907-6283-468f-af02-49896a68aef8 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:41:21 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-bdcc4907-6283-468f-af02-49896a68aef8 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:41:21 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-bdcc4907-6283-468f-af02-49896a68aef8 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:41:21 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-bdcc4907-6283-468f-af02-49896a68aef8 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:41:21 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-bdcc4907-6283-468f-af02-49896a68aef8 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:41:21 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-bdcc4907-6283-468f-af02-49896a68aef8 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] HTTP exception thrown: Instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 could not be found. Apr 11 15:41:21 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-bdcc4907-6283-468f-af02-49896a68aef8 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Request method failure captured: Apr 11 15:41:21 user devstack@n-api.service[61166]: request: GET /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8 HTTP/1.1 Apr 11 15:41:21 user devstack@n-api.service[61166]: Accept: application/json Apr 11 15:41:21 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 15:41:21 user devstack@n-api.service[61166]: Connection: close Apr 11 15:41:21 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 15:41:21 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 15:41:21 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 15:41:21 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 15:41:21 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 15:41:21 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNX5BcTshUbhWFRlg8t_zz9-lO37xLS5_qPcHcMwZTMQwRt4-or551ovVhKCAIBaCeMNrORffTlZsBlQimdDmzpIuoYxvEBmKfToUDowo0nTS3d21BIn-SO-2Yx-r5ng4wKQzH6UThKxvWXMHzNTatOGJbb71hvxv9ohtGR1eUXPnvUI Apr 11 15:41:21 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 15:41:21 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 15:41:21 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 15:41:21 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 15:41:21 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 15:41:21 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 15:41:21 user devstack@n-api.service[61166]: X-Project-Id: c23461a3d7ca49f6a77d3fde6f1009d3 Apr 11 15:41:21 user devstack@n-api.service[61166]: X-Project-Name: tempest-TestMinimumBasicScenario-673773229 Apr 11 15:41:21 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 15:41:21 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 15:41:21 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c23461a3d7ca49f6a77d3fde6f1009d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c23461a3d7ca49f6a77d3fde6f1009d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c23461a3d7ca49f6a77d3fde6f1009d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:41:21 user devstack@n-api.service[61166]: X-Tenant: tempest-TestMinimumBasicScenario-673773229 Apr 11 15:41:21 user devstack@n-api.service[61166]: X-Tenant-Id: c23461a3d7ca49f6a77d3fde6f1009d3 Apr 11 15:41:21 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-TestMinimumBasicScenario-673773229 Apr 11 15:41:21 user devstack@n-api.service[61166]: X-User: tempest-TestMinimumBasicScenario-673773229-project-member Apr 11 15:41:21 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 15:41:21 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 15:41:21 user devstack@n-api.service[61166]: X-User-Id: 044f17aee3324b3a97bebe935548b3b4 Apr 11 15:41:21 user devstack@n-api.service[61166]: X-User-Name: tempest-TestMinimumBasicScenario-673773229-project-member Apr 11 15:41:21 user devstack@n-api.service[61166]: method: > Apr 11 15:41:21 user devstack@n-api.service[61166]: exception: Instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 could not be found. Apr 11 15:41:21 user devstack@n-api.service[61166]: action_args: {'id': '1e3d0956-d528-4097-a200-d9b2b6ce7aa8'} Apr 11 15:41:21 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 could not be found. Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 could not be found. Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 could not be found. Apr 11 15:41:21 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:41:21 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-bdcc4907-6283-468f-af02-49896a68aef8 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Returning 404 to user: Instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 could not be found. {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:41:21 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-bdcc4907-6283-468f-af02-49896a68aef8 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8" status: 404 len: 111 microversion: 2.1 time: 0.396489 Apr 11 15:41:21 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 245/736] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:41:21 2023] GET /compute/v2.1/servers/1e3d0956-d528-4097-a200-d9b2b6ce7aa8 => generated 111 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:41:21 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-bba6da85-cc50-4eb0-80cf-d330db538e54 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '.version_select at 0x7f4c2eb553f0>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:41:21 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:41:21 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:41:21 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-bba6da85-cc50-4eb0-80cf-d330db538e54 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1861021757" status: 202 len: 0 microversion: 2.1 time: 0.034424 Apr 11 15:41:21 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 249/737] 10.0.0.210 () {62 vars in 1349 bytes} [Tue Apr 11 15:41:21 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1861021757 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:41:24 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-3cebc3a0-dbab-495a-b9a5-c0f4d6f050fb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Action: 'create', calling method: .version_select at 0x7f4c2ebda5f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-476755655", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEi4e2JA/PL1tAOhcKlKt8FTH71kaR0W8XoERLXcyazkBigSjzY+dpYEFC9a+OYtBKc4ccV+zmtRPE4sE6bLSGB//HIVXoOcZ03OattPC2GZ2XpT9tuqlDYpxg3EGGGEOg=="}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:41:24 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-3cebc3a0-dbab-495a-b9a5-c0f4d6f050fb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Getting quotas for project c23461a3d7ca49f6a77d3fde6f1009d3. Resources: {'key_pairs'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:41:24 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-3cebc3a0-dbab-495a-b9a5-c0f4d6f050fb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Getting quotas for user 044f17aee3324b3a97bebe935548b3b4 and project c23461a3d7ca49f6a77d3fde6f1009d3. Resources: {'key_pairs'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:41:24 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-3cebc3a0-dbab-495a-b9a5-c0f4d6f050fb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.051955 Apr 11 15:41:24 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 244/738] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 15:41:24 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:41:24 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-658332042", "imageRef": "549c0060-ec14-4185-b1e7-cc908fe9383a", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-476755655", "networks": [{"uuid": "b1189892-ba9d-4316-9962-c737b27f14bb"}]}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:41:24 user devstack@n-api.service[61166]: DEBUG nova.network.neutron [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] validate_networks() for [('b1189892-ba9d-4316-9962-c737b27f14bb', None, None, None, None, None)] {{(pid=61166) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:41:25 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Flavor limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:41:25 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Image limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:41:25 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Flavor pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:41:25 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Image pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:41:25 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:41:25 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:41:25 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:41:25 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:41:25 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:41:25 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:41:25 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:41:25 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Getting quotas for project c23461a3d7ca49f6a77d3fde6f1009d3. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:41:25 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Getting quotas for user 044f17aee3324b3a97bebe935548b3b4 and project c23461a3d7ca49f6a77d3fde6f1009d3. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:41:25 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Going to run 1 instances... {{(pid=61166) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:41:25 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='549c0060-ec14-4185-b1e7-cc908fe9383a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:41:25 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.714396 Apr 11 15:41:25 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 246/739] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 15:41:24 2023] POST /compute/v2.1/servers => generated 378 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 15:41:25 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-781e1889-f935-4a52-8712-baff55ccba3a tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:41:25 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-781e1889-f935-4a52-8712-baff55ccba3a tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:41:25 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-781e1889-f935-4a52-8712-baff55ccba3a tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044f17aee3324b3a97bebe935548b3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23461a3d7ca49f6a77d3fde6f1009d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:41:25 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-781e1889-f935-4a52-8712-baff55ccba3a tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd" status: 200 len: 1251 microversion: 2.1 time: 0.232874 Apr 11 15:41:25 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 250/740] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:41:25 2023] GET /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd => generated 1251 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:41:25 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-934c731f-cd93-41e4-938a-edd2132799c9 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:41:25 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-934c731f-cd93-41e4-938a-edd2132799c9 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:41:25 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-934c731f-cd93-41e4-938a-edd2132799c9 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:41:25 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-934c731f-cd93-41e4-938a-edd2132799c9 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:41:25 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-934c731f-cd93-41e4-938a-edd2132799c9 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:41:25 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-934c731f-cd93-41e4-938a-edd2132799c9 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:41:25 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-934c731f-cd93-41e4-938a-edd2132799c9 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:41:25 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-934c731f-cd93-41e4-938a-edd2132799c9 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:41:25 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-934c731f-cd93-41e4-938a-edd2132799c9 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8492f96e5d4f54aaae3679c82b6759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd700a53aa25849e0afd562b05881d09a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:41:25 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-934c731f-cd93-41e4-938a-edd2132799c9 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f6ae64a-c760-4ba3-8a50-d380835d9913" status: 200 len: 1491 microversion: 2.1 time: 0.261771 Apr 11 15:41:25 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 245/741] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:41:25 2023] GET /compute/v2.1/servers/6f6ae64a-c760-4ba3-8a50-d380835d9913 => generated 1491 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:41:28 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-58da0d1d-8c2a-4a40-99fa-d516425b269b req-cd137ee0-203d-49a8-ad5c-146a106cd9bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e816ce5-4da8-4366-9fa1-c33a45ba87fd", "tag": "7f4d2694-64e4-4dd0-af87-84d67de89287"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:41:28 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-58da0d1d-8c2a-4a40-99fa-d516425b269b req-cd137ee0-203d-49a8-ad5c-146a106cd9bb service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:41:28 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-58da0d1d-8c2a-4a40-99fa-d516425b269b req-cd137ee0-203d-49a8-ad5c-146a106cd9bb service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:41:28 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-58da0d1d-8c2a-4a40-99fa-d516425b269b req-cd137ee0-203d-49a8-ad5c-146a106cd9bb service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:41:28 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-58da0d1d-8c2a-4a40-99fa-d516425b269b req-cd137ee0-203d-49a8-ad5c-146a106cd9bb service nova] Creating event network-changed:7f4d2694-64e4-4dd0-af87-84d67de89287 for instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd on user Apr 11 15:41:28 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-58da0d1d-8c2a-4a40-99fa-d516425b269b req-cd137ee0-203d-49a8-ad5c-146a106cd9bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037879 Apr 11 15:41:28 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 247/742] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:41:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:41:30 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-32b8df62-2341-4aff-a94e-96f4d98576e5 req-dd9d5a96-2d3f-478e-9cd8-c77241f92487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e816ce5-4da8-4366-9fa1-c33a45ba87fd", "name": "network-vif-plugged", "status": "completed", "tag": "7f4d2694-64e4-4dd0-af87-84d67de89287"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:41:31 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-32b8df62-2341-4aff-a94e-96f4d98576e5 req-dd9d5a96-2d3f-478e-9cd8-c77241f92487 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:41:31 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-32b8df62-2341-4aff-a94e-96f4d98576e5 req-dd9d5a96-2d3f-478e-9cd8-c77241f92487 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:41:31 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-32b8df62-2341-4aff-a94e-96f4d98576e5 req-dd9d5a96-2d3f-478e-9cd8-c77241f92487 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:41:31 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-32b8df62-2341-4aff-a94e-96f4d98576e5 req-dd9d5a96-2d3f-478e-9cd8-c77241f92487 service nova] Creating event network-vif-plugged:7f4d2694-64e4-4dd0-af87-84d67de89287 for instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd on user Apr 11 15:41:31 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-32b8df62-2341-4aff-a94e-96f4d98576e5 req-dd9d5a96-2d3f-478e-9cd8-c77241f92487 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029813 Apr 11 15:41:31 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 251/743] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:41:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:41:33 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-dbf26538-d944-41c5-91da-edfdf4ae82d4 req-afafcb50-cf3f-4ae6-b3d5-564dbc9a07dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e816ce5-4da8-4366-9fa1-c33a45ba87fd", "name": "network-vif-plugged", "status": "completed", "tag": "7f4d2694-64e4-4dd0-af87-84d67de89287"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:41:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-dbf26538-d944-41c5-91da-edfdf4ae82d4 req-afafcb50-cf3f-4ae6-b3d5-564dbc9a07dc service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:41:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-dbf26538-d944-41c5-91da-edfdf4ae82d4 req-afafcb50-cf3f-4ae6-b3d5-564dbc9a07dc service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:41:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-dbf26538-d944-41c5-91da-edfdf4ae82d4 req-afafcb50-cf3f-4ae6-b3d5-564dbc9a07dc service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:41:33 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-dbf26538-d944-41c5-91da-edfdf4ae82d4 req-afafcb50-cf3f-4ae6-b3d5-564dbc9a07dc service nova] Creating event network-vif-plugged:7f4d2694-64e4-4dd0-af87-84d67de89287 for instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd on user Apr 11 15:41:33 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-dbf26538-d944-41c5-91da-edfdf4ae82d4 req-afafcb50-cf3f-4ae6-b3d5-564dbc9a07dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029747 Apr 11 15:41:33 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 246/744] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:41:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:41:51 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-a74ee5ae-9c74-47ce-ab20-e21ac164811e tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:41:51 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-a74ee5ae-9c74-47ce-ab20-e21ac164811e tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:41:51 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:41:51 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:41:51 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:41:51 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:41:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-a74ee5ae-9c74-47ce-ab20-e21ac164811e tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:41:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-a74ee5ae-9c74-47ce-ab20-e21ac164811e tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:41:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-a74ee5ae-9c74-47ce-ab20-e21ac164811e tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:41:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-a74ee5ae-9c74-47ce-ab20-e21ac164811e tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:41:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-a74ee5ae-9c74-47ce-ab20-e21ac164811e tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:41:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-a74ee5ae-9c74-47ce-ab20-e21ac164811e tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:41:51 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-a74ee5ae-9c74-47ce-ab20-e21ac164811e tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:41:51 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-a74ee5ae-9c74-47ce-ab20-e21ac164811e tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4" status: 200 len: 1546 microversion: 2.1 time: 0.181985 Apr 11 15:41:51 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 248/745] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:41:51 2023] GET /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4 => generated 1546 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:42:14 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:42:14 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:42:14 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:42:14 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-430537775", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "7dd85c86-9339-4862-8de7-a199b74565a6", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24"}]}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:42:14 user devstack@n-api.service[61167]: DEBUG nova.network.neutron [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] validate_networks() for [('8d262ba8-b9c3-44ed-8431-6c295eb9ea24', None, None, None, None, None)] {{(pid=61167) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:42:14 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Flavor limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:42:14 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Image limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:42:14 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Flavor pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:42:14 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Image pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:42:14 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:42:14 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:42:14 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:42:14 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:42:14 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:42:14 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:42:14 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:42:14 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Getting quotas for project 312851c65ba1434691eca0cd2a8cd6d2. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:42:14 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Getting quotas for user c2110b74f38642afa560e1c9790d3f81 and project 312851c65ba1434691eca0cd2a8cd6d2. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:42:14 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Going to run 1 instances... {{(pid=61167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:42:14 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='7dd85c86-9339-4862-8de7-a199b74565a6',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:42:14 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.595593 Apr 11 15:42:14 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 252/746] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 15:42:14 2023] POST /compute/v2.1/servers => generated 378 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 15:42:14 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:42:14 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:42:14 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=10 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:42:14 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-0dac29c5-12f9-48ae-b2ac-ca3758a0fb11 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:42:14 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-0dac29c5-12f9-48ae-b2ac-ca3758a0fb11 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:42:14 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-0dac29c5-12f9-48ae-b2ac-ca3758a0fb11 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2110b74f38642afa560e1c9790d3f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312851c65ba1434691eca0cd2a8cd6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:42:14 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-0dac29c5-12f9-48ae-b2ac-ca3758a0fb11 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f51cc22-e687-40e2-899a-72f2f169b154" status: 200 len: 1051 microversion: 2.1 time: 0.177953 Apr 11 15:42:14 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 247/747] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:42:14 2023] GET /compute/v2.1/servers/4f51cc22-e687-40e2-899a-72f2f169b154 => generated 1051 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:42:15 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-0bef15e8-f9f4-4521-b2a8-e8db6b5d1981 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:42:15 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-0bef15e8-f9f4-4521-b2a8-e8db6b5d1981 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:42:15 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:42:15 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:42:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0bef15e8-f9f4-4521-b2a8-e8db6b5d1981 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:42:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0bef15e8-f9f4-4521-b2a8-e8db6b5d1981 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:42:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0bef15e8-f9f4-4521-b2a8-e8db6b5d1981 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:42:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0bef15e8-f9f4-4521-b2a8-e8db6b5d1981 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:42:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0bef15e8-f9f4-4521-b2a8-e8db6b5d1981 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:42:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-0bef15e8-f9f4-4521-b2a8-e8db6b5d1981 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:42:15 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-0bef15e8-f9f4-4521-b2a8-e8db6b5d1981 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044f17aee3324b3a97bebe935548b3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23461a3d7ca49f6a77d3fde6f1009d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:42:15 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-0bef15e8-f9f4-4521-b2a8-e8db6b5d1981 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd" status: 200 len: 1535 microversion: 2.1 time: 0.161570 Apr 11 15:42:15 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 249/748] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:42:15 2023] GET /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd => generated 1535 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:42:17 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-540f910b-dca5-4a61-87ee-9425a898959d req-a283ca3c-8209-41d6-80e5-293757b8243e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f51cc22-e687-40e2-899a-72f2f169b154", "tag": "66c0193e-7320-4344-8ef3-419b21bbbba7"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:42:17 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-540f910b-dca5-4a61-87ee-9425a898959d req-a283ca3c-8209-41d6-80e5-293757b8243e service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:42:17 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-540f910b-dca5-4a61-87ee-9425a898959d req-a283ca3c-8209-41d6-80e5-293757b8243e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:42:17 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-540f910b-dca5-4a61-87ee-9425a898959d req-a283ca3c-8209-41d6-80e5-293757b8243e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:42:17 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-540f910b-dca5-4a61-87ee-9425a898959d req-a283ca3c-8209-41d6-80e5-293757b8243e service nova] Creating event network-changed:66c0193e-7320-4344-8ef3-419b21bbbba7 for instance 4f51cc22-e687-40e2-899a-72f2f169b154 on user Apr 11 15:42:17 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-540f910b-dca5-4a61-87ee-9425a898959d req-a283ca3c-8209-41d6-80e5-293757b8243e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031440 Apr 11 15:42:17 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 253/749] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:42:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:42:25 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-73d5aa76-275a-4807-864c-b2be22d43849 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88192d24-c517-4660-9616-219b17437dca"}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:42:25 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-73d5aa76-275a-4807-864c-b2be22d43849 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:42:25 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:42:25 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:42:25 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-73d5aa76-275a-4807-864c-b2be22d43849 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:42:25 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-73d5aa76-275a-4807-864c-b2be22d43849 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:42:25 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-73d5aa76-275a-4807-864c-b2be22d43849 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:42:25 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-73d5aa76-275a-4807-864c-b2be22d43849 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:42:25 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-73d5aa76-275a-4807-864c-b2be22d43849 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:42:25 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-73d5aa76-275a-4807-864c-b2be22d43849 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:42:25 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-73d5aa76-275a-4807-864c-b2be22d43849 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] HTTP exception thrown: Cannot 'attach_volume' instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 while it is in vm_state rescued Apr 11 15:42:25 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-73d5aa76-275a-4807-864c-b2be22d43849 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Request method failure captured: Apr 11 15:42:25 user devstack@n-api.service[61165]: request: POST /compute/v2.1/servers/6f6ae64a-c760-4ba3-8a50-d380835d9913/os-volume_attachments HTTP/1.1 Apr 11 15:42:25 user devstack@n-api.service[61165]: Accept: application/json Apr 11 15:42:25 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 15:42:25 user devstack@n-api.service[61165]: Connection: close Apr 11 15:42:25 user devstack@n-api.service[61165]: Content-Length: 74 Apr 11 15:42:25 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 15:42:25 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 15:42:25 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 15:42:25 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 15:42:25 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNX5Xpp64UjUCTvokQPchz3Z_zzZld6Gzzdi5g5f3dAzZMYNbfpuD5SVzUtCVXDSbv-6uA4tdlV5bq4l7Mfh7qU6Z3TnkgMq20ehg7ZRY4FWJXSHNtB12atJ6Is1L1bASyUvXy3UohCr63-e-VGzFJVGpcxBwakeRjEJokogPDcce5GQ Apr 11 15:42:25 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 15:42:25 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 15:42:25 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 15:42:25 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 15:42:25 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 15:42:25 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 15:42:25 user devstack@n-api.service[61165]: X-Project-Id: d700a53aa25849e0afd562b05881d09a Apr 11 15:42:25 user devstack@n-api.service[61165]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1491000769 Apr 11 15:42:25 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 15:42:25 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 15:42:25 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d700a53aa25849e0afd562b05881d09a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d700a53aa25849e0afd562b05881d09a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d700a53aa25849e0afd562b05881d09a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:42:25 user devstack@n-api.service[61165]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1491000769 Apr 11 15:42:25 user devstack@n-api.service[61165]: X-Tenant-Id: d700a53aa25849e0afd562b05881d09a Apr 11 15:42:25 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1491000769 Apr 11 15:42:25 user devstack@n-api.service[61165]: X-User: tempest-ServerRescueNegativeTestJSON-1491000769-project-member Apr 11 15:42:25 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 15:42:25 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 15:42:25 user devstack@n-api.service[61165]: X-User-Id: 5c8492f96e5d4f54aaae3679c82b6759 Apr 11 15:42:25 user devstack@n-api.service[61165]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1491000769-project-member Apr 11 15:42:25 user devstack@n-api.service[61165]: Apr 11 15:42:25 user devstack@n-api.service[61165]: {"volumeAttachment": {"volumeId": "88192d24-c517-4660-9616-219b17437dca"}} Apr 11 15:42:25 user devstack@n-api.service[61165]: method: > Apr 11 15:42:25 user devstack@n-api.service[61165]: exception: Cannot 'attach_volume' instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 while it is in vm_state rescued Apr 11 15:42:25 user devstack@n-api.service[61165]: action_args: {'server_id': '6f6ae64a-c760-4ba3-8a50-d380835d9913', 'body': {'volumeAttachment': {'volumeId': '88192d24-c517-4660-9616-219b17437dca'}}} Apr 11 15:42:25 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 while it is in vm_state rescued Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 while it is in vm_state rescued Apr 11 15:42:25 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:42:25 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-73d5aa76-275a-4807-864c-b2be22d43849 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Returning 409 to user: Cannot 'attach_volume' instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 while it is in vm_state rescued {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:42:25 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-73d5aa76-275a-4807-864c-b2be22d43849 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6f6ae64a-c760-4ba3-8a50-d380835d9913/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.051154 Apr 11 15:42:25 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 248/750] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 15:42:25 2023] POST /compute/v2.1/servers/6f6ae64a-c760-4ba3-8a50-d380835d9913/os-volume_attachments => generated 152 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 11 15:42:25 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-db941114-5382-4229-b58a-1cbd22f68ad4 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:42:25 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-db941114-5382-4229-b58a-1cbd22f68ad4 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:42:25 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:42:25 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:42:25 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-db941114-5382-4229-b58a-1cbd22f68ad4 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:42:25 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-db941114-5382-4229-b58a-1cbd22f68ad4 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:42:25 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-db941114-5382-4229-b58a-1cbd22f68ad4 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:42:25 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-db941114-5382-4229-b58a-1cbd22f68ad4 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:42:25 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-db941114-5382-4229-b58a-1cbd22f68ad4 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:42:25 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-db941114-5382-4229-b58a-1cbd22f68ad4 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:42:25 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-db941114-5382-4229-b58a-1cbd22f68ad4 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6f6ae64a-c760-4ba3-8a50-d380835d9913/action" status: 202 len: 0 microversion: 2.1 time: 0.090175 Apr 11 15:42:25 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 250/751] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 15:42:25 2023] POST /compute/v2.1/servers/6f6ae64a-c760-4ba3-8a50-d380835d9913/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:42:25 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:42:25 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:42:25 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-4e50036f-b6c0-4e0b-9591-f6b8f53b01d6 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:42:25 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-4e50036f-b6c0-4e0b-9591-f6b8f53b01d6 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:42:25 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4e50036f-b6c0-4e0b-9591-f6b8f53b01d6 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:42:25 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4e50036f-b6c0-4e0b-9591-f6b8f53b01d6 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:42:25 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4e50036f-b6c0-4e0b-9591-f6b8f53b01d6 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:42:25 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4e50036f-b6c0-4e0b-9591-f6b8f53b01d6 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:42:25 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4e50036f-b6c0-4e0b-9591-f6b8f53b01d6 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:42:25 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4e50036f-b6c0-4e0b-9591-f6b8f53b01d6 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:42:26 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-4e50036f-b6c0-4e0b-9591-f6b8f53b01d6 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8492f96e5d4f54aaae3679c82b6759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd700a53aa25849e0afd562b05881d09a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:42:26 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-4e50036f-b6c0-4e0b-9591-f6b8f53b01d6 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f6ae64a-c760-4ba3-8a50-d380835d9913" status: 200 len: 1499 microversion: 2.1 time: 0.167618 Apr 11 15:42:26 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 254/752] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:42:25 2023] GET /compute/v2.1/servers/6f6ae64a-c760-4ba3-8a50-d380835d9913 => generated 1499 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:42:26 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-c21dd10b-61e8-49ef-bbba-45af30cad9f9 req-66a239cc-abd0-455d-ade0-86cecc1f8e3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f6ae64a-c760-4ba3-8a50-d380835d9913", "name": "network-vif-unplugged", "status": "completed", "tag": "2b891eeb-973f-492a-9059-55961bb956bf"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:42:26 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-c21dd10b-61e8-49ef-bbba-45af30cad9f9 req-66a239cc-abd0-455d-ade0-86cecc1f8e3a service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:42:26 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-c21dd10b-61e8-49ef-bbba-45af30cad9f9 req-66a239cc-abd0-455d-ade0-86cecc1f8e3a service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:42:26 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-c21dd10b-61e8-49ef-bbba-45af30cad9f9 req-66a239cc-abd0-455d-ade0-86cecc1f8e3a service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:42:26 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-c21dd10b-61e8-49ef-bbba-45af30cad9f9 req-66a239cc-abd0-455d-ade0-86cecc1f8e3a service nova] Creating event network-vif-unplugged:2b891eeb-973f-492a-9059-55961bb956bf for instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 on user Apr 11 15:42:26 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-c21dd10b-61e8-49ef-bbba-45af30cad9f9 req-66a239cc-abd0-455d-ade0-86cecc1f8e3a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100223 Apr 11 15:42:26 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 249/753] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:42:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:42:28 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-24a9ee76-b17f-4065-bc47-60f5df4d94f1 req-cc72a252-9f9b-480c-8289-aec42b38fb07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f6ae64a-c760-4ba3-8a50-d380835d9913", "name": "network-vif-plugged", "status": "completed", "tag": "2b891eeb-973f-492a-9059-55961bb956bf"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:42:28 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-24a9ee76-b17f-4065-bc47-60f5df4d94f1 req-cc72a252-9f9b-480c-8289-aec42b38fb07 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:42:28 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-24a9ee76-b17f-4065-bc47-60f5df4d94f1 req-cc72a252-9f9b-480c-8289-aec42b38fb07 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:42:28 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-24a9ee76-b17f-4065-bc47-60f5df4d94f1 req-cc72a252-9f9b-480c-8289-aec42b38fb07 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:42:28 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-24a9ee76-b17f-4065-bc47-60f5df4d94f1 req-cc72a252-9f9b-480c-8289-aec42b38fb07 service nova] Creating event network-vif-plugged:2b891eeb-973f-492a-9059-55961bb956bf for instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 on user Apr 11 15:42:28 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-24a9ee76-b17f-4065-bc47-60f5df4d94f1 req-cc72a252-9f9b-480c-8289-aec42b38fb07 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042163 Apr 11 15:42:28 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 251/754] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:42:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:42:29 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-dc8c9115-b04d-4751-93b8-2daceda4a035 req-d6b75220-1f53-4b24-b7b2-edb00f141323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f51cc22-e687-40e2-899a-72f2f169b154", "name": "network-vif-plugged", "status": "completed", "tag": "66c0193e-7320-4344-8ef3-419b21bbbba7"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:42:29 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-dc8c9115-b04d-4751-93b8-2daceda4a035 req-d6b75220-1f53-4b24-b7b2-edb00f141323 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:42:29 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-dc8c9115-b04d-4751-93b8-2daceda4a035 req-d6b75220-1f53-4b24-b7b2-edb00f141323 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:42:29 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-dc8c9115-b04d-4751-93b8-2daceda4a035 req-d6b75220-1f53-4b24-b7b2-edb00f141323 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:42:29 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-dc8c9115-b04d-4751-93b8-2daceda4a035 req-d6b75220-1f53-4b24-b7b2-edb00f141323 service nova] Creating event network-vif-plugged:66c0193e-7320-4344-8ef3-419b21bbbba7 for instance 4f51cc22-e687-40e2-899a-72f2f169b154 on user Apr 11 15:42:29 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-dc8c9115-b04d-4751-93b8-2daceda4a035 req-d6b75220-1f53-4b24-b7b2-edb00f141323 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111012 Apr 11 15:42:29 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 255/755] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:42:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:42:30 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-48c2ab8b-362d-4351-b9d6-94ab00599741 req-88eb2b83-f7ac-43f3-9b27-77593dec7616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f6ae64a-c760-4ba3-8a50-d380835d9913", "name": "network-vif-plugged", "status": "completed", "tag": "2b891eeb-973f-492a-9059-55961bb956bf"}, {"server_uuid": "6f6ae64a-c760-4ba3-8a50-d380835d9913", "name": "network-vif-plugged", "status": "completed", "tag": "2b891eeb-973f-492a-9059-55961bb956bf"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:42:30 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-48c2ab8b-362d-4351-b9d6-94ab00599741 req-88eb2b83-f7ac-43f3-9b27-77593dec7616 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:42:30 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-48c2ab8b-362d-4351-b9d6-94ab00599741 req-88eb2b83-f7ac-43f3-9b27-77593dec7616 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:42:30 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-48c2ab8b-362d-4351-b9d6-94ab00599741 req-88eb2b83-f7ac-43f3-9b27-77593dec7616 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:42:30 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-48c2ab8b-362d-4351-b9d6-94ab00599741 req-88eb2b83-f7ac-43f3-9b27-77593dec7616 service nova] Creating event network-vif-plugged:2b891eeb-973f-492a-9059-55961bb956bf for instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 on user Apr 11 15:42:30 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-48c2ab8b-362d-4351-b9d6-94ab00599741 req-88eb2b83-f7ac-43f3-9b27-77593dec7616 service nova] Creating event network-vif-plugged:2b891eeb-973f-492a-9059-55961bb956bf for instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 on user Apr 11 15:42:30 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-48c2ab8b-362d-4351-b9d6-94ab00599741 req-88eb2b83-f7ac-43f3-9b27-77593dec7616 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029418 Apr 11 15:42:30 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 250/756] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:42:30 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:42:32 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-62b5e447-5006-4b1e-b64b-296a5bd4d365 req-08d5268d-22d6-4c7e-be8c-aecd100f3687 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f51cc22-e687-40e2-899a-72f2f169b154", "name": "network-vif-plugged", "status": "completed", "tag": "66c0193e-7320-4344-8ef3-419b21bbbba7"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:42:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-62b5e447-5006-4b1e-b64b-296a5bd4d365 req-08d5268d-22d6-4c7e-be8c-aecd100f3687 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:42:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-62b5e447-5006-4b1e-b64b-296a5bd4d365 req-08d5268d-22d6-4c7e-be8c-aecd100f3687 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:42:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-62b5e447-5006-4b1e-b64b-296a5bd4d365 req-08d5268d-22d6-4c7e-be8c-aecd100f3687 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:42:32 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-62b5e447-5006-4b1e-b64b-296a5bd4d365 req-08d5268d-22d6-4c7e-be8c-aecd100f3687 service nova] Creating event network-vif-plugged:66c0193e-7320-4344-8ef3-419b21bbbba7 for instance 4f51cc22-e687-40e2-899a-72f2f169b154 on user Apr 11 15:42:32 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-62b5e447-5006-4b1e-b64b-296a5bd4d365 req-08d5268d-22d6-4c7e-be8c-aecd100f3687 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032185 Apr 11 15:42:32 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 252/757] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:42:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:42:51 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:42:51 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=12 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:42:51 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-8b02e0fd-f502-467a-bde5-2b8ae60d1d7a tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:42:51 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-8b02e0fd-f502-467a-bde5-2b8ae60d1d7a tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:42:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8b02e0fd-f502-467a-bde5-2b8ae60d1d7a tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:42:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8b02e0fd-f502-467a-bde5-2b8ae60d1d7a tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:42:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8b02e0fd-f502-467a-bde5-2b8ae60d1d7a tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:42:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8b02e0fd-f502-467a-bde5-2b8ae60d1d7a tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:42:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8b02e0fd-f502-467a-bde5-2b8ae60d1d7a tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:42:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8b02e0fd-f502-467a-bde5-2b8ae60d1d7a tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:42:51 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-8b02e0fd-f502-467a-bde5-2b8ae60d1d7a tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:42:51 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-8b02e0fd-f502-467a-bde5-2b8ae60d1d7a tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4" status: 200 len: 1546 microversion: 2.1 time: 0.281579 Apr 11 15:42:51 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 256/758] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:42:51 2023] GET /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4 => generated 1546 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:42:51 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-7ab5ac2f-bdd9-4bef-8c58-a3e744b5cd5f tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:42:51 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-7ab5ac2f-bdd9-4bef-8c58-a3e744b5cd5f tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:42:51 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:42:51 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=8 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:42:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7ab5ac2f-bdd9-4bef-8c58-a3e744b5cd5f tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:42:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7ab5ac2f-bdd9-4bef-8c58-a3e744b5cd5f tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:42:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7ab5ac2f-bdd9-4bef-8c58-a3e744b5cd5f tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:42:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7ab5ac2f-bdd9-4bef-8c58-a3e744b5cd5f tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:42:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7ab5ac2f-bdd9-4bef-8c58-a3e744b5cd5f tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:42:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-7ab5ac2f-bdd9-4bef-8c58-a3e744b5cd5f tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:42:51 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-7ab5ac2f-bdd9-4bef-8c58-a3e744b5cd5f tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4/action" status: 200 len: 28485 microversion: 2.1 time: 0.214748 Apr 11 15:42:51 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 251/759] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 15:42:51 2023] POST /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4/action => generated 28485 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 15:42:51 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:42:51 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:42:51 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-ffe533e4-0aad-4c99-8be6-a00f6f168e29 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:42:51 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-ffe533e4-0aad-4c99-8be6-a00f6f168e29 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:42:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ffe533e4-0aad-4c99-8be6-a00f6f168e29 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:42:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ffe533e4-0aad-4c99-8be6-a00f6f168e29 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:42:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ffe533e4-0aad-4c99-8be6-a00f6f168e29 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:42:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ffe533e4-0aad-4c99-8be6-a00f6f168e29 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:42:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ffe533e4-0aad-4c99-8be6-a00f6f168e29 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:42:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-ffe533e4-0aad-4c99-8be6-a00f6f168e29 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:42:52 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-ffe533e4-0aad-4c99-8be6-a00f6f168e29 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:42:52 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-ffe533e4-0aad-4c99-8be6-a00f6f168e29 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e" status: 200 len: 1540 microversion: 2.1 time: 0.147996 Apr 11 15:42:52 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 253/760] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:42:51 2023] GET /compute/v2.1/servers/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e => generated 1540 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:43:05 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-761ad7f9-aad9-4027-b956-f75f917b3c25 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:43:05 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-761ad7f9-aad9-4027-b956-f75f917b3c25 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:43:05 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:43:05 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:43:05 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-761ad7f9-aad9-4027-b956-f75f917b3c25 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:05 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-761ad7f9-aad9-4027-b956-f75f917b3c25 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:05 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-761ad7f9-aad9-4027-b956-f75f917b3c25 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:05 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-761ad7f9-aad9-4027-b956-f75f917b3c25 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:05 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-761ad7f9-aad9-4027-b956-f75f917b3c25 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:05 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-761ad7f9-aad9-4027-b956-f75f917b3c25 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:05 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-761ad7f9-aad9-4027-b956-f75f917b3c25 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2110b74f38642afa560e1c9790d3f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312851c65ba1434691eca0cd2a8cd6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:43:05 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-761ad7f9-aad9-4027-b956-f75f917b3c25 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f51cc22-e687-40e2-899a-72f2f169b154" status: 200 len: 1378 microversion: 2.1 time: 0.160684 Apr 11 15:43:05 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 257/761] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:43:04 2023] GET /compute/v2.1/servers/4f51cc22-e687-40e2-899a-72f2f169b154 => generated 1378 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:43:15 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:43:15 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:43:15 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-cadfc646-4e3b-4c3d-895a-62c61b76dbfd tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:43:15 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-cadfc646-4e3b-4c3d-895a-62c61b76dbfd tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:43:15 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cadfc646-4e3b-4c3d-895a-62c61b76dbfd tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:15 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cadfc646-4e3b-4c3d-895a-62c61b76dbfd tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:15 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cadfc646-4e3b-4c3d-895a-62c61b76dbfd tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:15 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cadfc646-4e3b-4c3d-895a-62c61b76dbfd tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:15 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cadfc646-4e3b-4c3d-895a-62c61b76dbfd tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:15 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cadfc646-4e3b-4c3d-895a-62c61b76dbfd tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:15 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-cadfc646-4e3b-4c3d-895a-62c61b76dbfd tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044f17aee3324b3a97bebe935548b3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23461a3d7ca49f6a77d3fde6f1009d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:43:15 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-cadfc646-4e3b-4c3d-895a-62c61b76dbfd tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd" status: 200 len: 1535 microversion: 2.1 time: 0.151088 Apr 11 15:43:15 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 252/762] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:43:15 2023] GET /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd => generated 1535 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:43:15 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-e50ec100-d3f3-4d01-b020-fa68ef7da76a tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:43:15 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-e50ec100-d3f3-4d01-b020-fa68ef7da76a tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '044f17aee3324b3a97bebe935548b3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23461a3d7ca49f6a77d3fde6f1009d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:43:15 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-e50ec100-d3f3-4d01-b020-fa68ef7da76a tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Searching by: {'deleted': False, 'project_id': 'c23461a3d7ca49f6a77d3fde6f1009d3'} {{(pid=61166) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 11 15:43:15 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:43:15 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:43:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e50ec100-d3f3-4d01-b020-fa68ef7da76a tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e50ec100-d3f3-4d01-b020-fa68ef7da76a tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e50ec100-d3f3-4d01-b020-fa68ef7da76a tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e50ec100-d3f3-4d01-b020-fa68ef7da76a tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e50ec100-d3f3-4d01-b020-fa68ef7da76a tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e50ec100-d3f3-4d01-b020-fa68ef7da76a tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:15 user devstack@n-api.service[61166]: DEBUG nova.compute.multi_cell_list [None req-e50ec100-d3f3-4d01-b020-fa68ef7da76a tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61166) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 11 15:43:16 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-ba7918d8-233b-4408-a773-3d0873f54fcb tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:43:16 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-ba7918d8-233b-4408-a773-3d0873f54fcb tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:43:16 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:43:16 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:43:16 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ba7918d8-233b-4408-a773-3d0873f54fcb tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:16 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ba7918d8-233b-4408-a773-3d0873f54fcb tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:16 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ba7918d8-233b-4408-a773-3d0873f54fcb tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:16 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ba7918d8-233b-4408-a773-3d0873f54fcb tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:16 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ba7918d8-233b-4408-a773-3d0873f54fcb tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:16 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ba7918d8-233b-4408-a773-3d0873f54fcb tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:16 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-ba7918d8-233b-4408-a773-3d0873f54fcb tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8492f96e5d4f54aaae3679c82b6759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd700a53aa25849e0afd562b05881d09a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:43:16 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-ba7918d8-233b-4408-a773-3d0873f54fcb tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f6ae64a-c760-4ba3-8a50-d380835d9913" status: 200 len: 1505 microversion: 2.1 time: 0.157914 Apr 11 15:43:16 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 258/763] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:43:16 2023] GET /compute/v2.1/servers/6f6ae64a-c760-4ba3-8a50-d380835d9913 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:43:16 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-e50ec100-d3f3-4d01-b020-fa68ef7da76a tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.457180 Apr 11 15:43:16 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 254/764] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Apr 11 15:43:15 2023] GET /compute/v2.1/servers => generated 340 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:43:16 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-9541d790-e911-43e5-b62b-d5f43ca76b8d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:43:16 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-9541d790-e911-43e5-b62b-d5f43ca76b8d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:43:16 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-9541d790-e911-43e5-b62b-d5f43ca76b8d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:16 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-9541d790-e911-43e5-b62b-d5f43ca76b8d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:16 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-9541d790-e911-43e5-b62b-d5f43ca76b8d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:16 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-9541d790-e911-43e5-b62b-d5f43ca76b8d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:16 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-9541d790-e911-43e5-b62b-d5f43ca76b8d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:16 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-9541d790-e911-43e5-b62b-d5f43ca76b8d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:16 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-9541d790-e911-43e5-b62b-d5f43ca76b8d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044f17aee3324b3a97bebe935548b3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23461a3d7ca49f6a77d3fde6f1009d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:43:16 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-9541d790-e911-43e5-b62b-d5f43ca76b8d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd" status: 200 len: 1535 microversion: 2.1 time: 0.146873 Apr 11 15:43:16 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 253/765] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:43:16 2023] GET /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd => generated 1535 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:43:18 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79"}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:43:18 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:43:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:18 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258392 Apr 11 15:43:18 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 259/766] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 15:43:18 2023] POST /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:43:25 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-37ca5c73-3a57-47e3-a0ba-1cd265ed5ef9 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:43:25 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-37ca5c73-3a57-47e3-a0ba-1cd265ed5ef9 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:43:25 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-37ca5c73-3a57-47e3-a0ba-1cd265ed5ef9 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:25 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-37ca5c73-3a57-47e3-a0ba-1cd265ed5ef9 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:25 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-37ca5c73-3a57-47e3-a0ba-1cd265ed5ef9 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:25 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-37ca5c73-3a57-47e3-a0ba-1cd265ed5ef9 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:25 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-37ca5c73-3a57-47e3-a0ba-1cd265ed5ef9 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:25 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-37ca5c73-3a57-47e3-a0ba-1cd265ed5ef9 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:25 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-37ca5c73-3a57-47e3-a0ba-1cd265ed5ef9 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044f17aee3324b3a97bebe935548b3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23461a3d7ca49f6a77d3fde6f1009d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:43:25 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-37ca5c73-3a57-47e3-a0ba-1cd265ed5ef9 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd" status: 200 len: 1581 microversion: 2.1 time: 0.149381 Apr 11 15:43:25 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 255/767] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:43:25 2023] GET /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd => generated 1581 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:43:26 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:43:26 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=12 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:43:26 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-25d3c1a8-3e12-4949-b119-60d4030364cc req-c4b43ce3-a94f-4398-bca8-873c2b79dafc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e816ce5-4da8-4366-9fa1-c33a45ba87fd", "tag": "7f4d2694-64e4-4dd0-af87-84d67de89287"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:43:26 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-25d3c1a8-3e12-4949-b119-60d4030364cc req-c4b43ce3-a94f-4398-bca8-873c2b79dafc service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:26 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-25d3c1a8-3e12-4949-b119-60d4030364cc req-c4b43ce3-a94f-4398-bca8-873c2b79dafc service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:26 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-25d3c1a8-3e12-4949-b119-60d4030364cc req-c4b43ce3-a94f-4398-bca8-873c2b79dafc service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:26 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-25d3c1a8-3e12-4949-b119-60d4030364cc req-c4b43ce3-a94f-4398-bca8-873c2b79dafc service nova] Creating event network-changed:7f4d2694-64e4-4dd0-af87-84d67de89287 for instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd on user Apr 11 15:43:26 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-25d3c1a8-3e12-4949-b119-60d4030364cc req-c4b43ce3-a94f-4398-bca8-873c2b79dafc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086686 Apr 11 15:43:26 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 254/768] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:43:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:43:27 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-85cc9b09-5118-4021-8b65-9ae9208a9f2d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1849978819"}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:43:27 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-85cc9b09-5118-4021-8b65-9ae9208a9f2d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:43:27 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-85cc9b09-5118-4021-8b65-9ae9208a9f2d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:27 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-85cc9b09-5118-4021-8b65-9ae9208a9f2d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:27 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-85cc9b09-5118-4021-8b65-9ae9208a9f2d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:27 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-85cc9b09-5118-4021-8b65-9ae9208a9f2d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:27 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-85cc9b09-5118-4021-8b65-9ae9208a9f2d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:27 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-85cc9b09-5118-4021-8b65-9ae9208a9f2d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:27 user devstack@n-api.service[61167]: INFO nova.network.security_group_api [None req-85cc9b09-5118-4021-8b65-9ae9208a9f2d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Adding security group 5e617e5e-c7fc-43ab-a247-c3834317c7d5 to port 7f4d2694-64e4-4dd0-af87-84d67de89287 Apr 11 15:43:28 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-85cc9b09-5118-4021-8b65-9ae9208a9f2d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/action" status: 202 len: 0 microversion: 2.1 time: 0.583429 Apr 11 15:43:28 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 260/769] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 15:43:27 2023] POST /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/action => generated 0 bytes in 585 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:43:28 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-d14716b9-f05d-4b2e-806b-f3b5b6df5ab6 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:43:28 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-d14716b9-f05d-4b2e-806b-f3b5b6df5ab6 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:43:28 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:43:28 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d14716b9-f05d-4b2e-806b-f3b5b6df5ab6 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:28 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d14716b9-f05d-4b2e-806b-f3b5b6df5ab6 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:28 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d14716b9-f05d-4b2e-806b-f3b5b6df5ab6 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:28 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d14716b9-f05d-4b2e-806b-f3b5b6df5ab6 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:28 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d14716b9-f05d-4b2e-806b-f3b5b6df5ab6 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:28 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d14716b9-f05d-4b2e-806b-f3b5b6df5ab6 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:28 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-d14716b9-f05d-4b2e-806b-f3b5b6df5ab6 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044f17aee3324b3a97bebe935548b3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23461a3d7ca49f6a77d3fde6f1009d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:43:28 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-d14716b9-f05d-4b2e-806b-f3b5b6df5ab6 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd" status: 200 len: 1745 microversion: 2.1 time: 0.155086 Apr 11 15:43:28 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 256/770] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:43:28 2023] GET /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:43:28 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-df250bbc-01c5-4c88-bc17-52c9df50a082 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:43:28 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-df250bbc-01c5-4c88-bc17-52c9df50a082 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:43:28 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-df250bbc-01c5-4c88-bc17-52c9df50a082 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:28 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-df250bbc-01c5-4c88-bc17-52c9df50a082 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:28 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-df250bbc-01c5-4c88-bc17-52c9df50a082 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:28 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-df250bbc-01c5-4c88-bc17-52c9df50a082 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:28 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-df250bbc-01c5-4c88-bc17-52c9df50a082 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:28 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-df250bbc-01c5-4c88-bc17-52c9df50a082 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:28 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-afeb5c83-2e30-4a3d-bf4d-fd51cc1c3575 req-3c8633c1-f739-4aa1-a1ce-6fbac756c7a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e816ce5-4da8-4366-9fa1-c33a45ba87fd", "tag": "7f4d2694-64e4-4dd0-af87-84d67de89287"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:43:28 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-afeb5c83-2e30-4a3d-bf4d-fd51cc1c3575 req-3c8633c1-f739-4aa1-a1ce-6fbac756c7a8 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:28 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-afeb5c83-2e30-4a3d-bf4d-fd51cc1c3575 req-3c8633c1-f739-4aa1-a1ce-6fbac756c7a8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:28 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-afeb5c83-2e30-4a3d-bf4d-fd51cc1c3575 req-3c8633c1-f739-4aa1-a1ce-6fbac756c7a8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:28 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-df250bbc-01c5-4c88-bc17-52c9df50a082 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/action" status: 202 len: 0 microversion: 2.1 time: 0.114583 Apr 11 15:43:28 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 255/771] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 15:43:28 2023] POST /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:43:28 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-480d5aed-38e5-47c8-8bc1-65efb0d03bb9 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:43:28 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-480d5aed-38e5-47c8-8bc1-65efb0d03bb9 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:43:28 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-afeb5c83-2e30-4a3d-bf4d-fd51cc1c3575 req-3c8633c1-f739-4aa1-a1ce-6fbac756c7a8 service nova] Creating event network-changed:7f4d2694-64e4-4dd0-af87-84d67de89287 for instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd on user Apr 11 15:43:28 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-480d5aed-38e5-47c8-8bc1-65efb0d03bb9 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:28 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-afeb5c83-2e30-4a3d-bf4d-fd51cc1c3575 req-3c8633c1-f739-4aa1-a1ce-6fbac756c7a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032982 Apr 11 15:43:28 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-480d5aed-38e5-47c8-8bc1-65efb0d03bb9 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:28 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-480d5aed-38e5-47c8-8bc1-65efb0d03bb9 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:28 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 261/772] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:43:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:43:28 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-480d5aed-38e5-47c8-8bc1-65efb0d03bb9 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:28 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-480d5aed-38e5-47c8-8bc1-65efb0d03bb9 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:28 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-480d5aed-38e5-47c8-8bc1-65efb0d03bb9 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:28 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-480d5aed-38e5-47c8-8bc1-65efb0d03bb9 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044f17aee3324b3a97bebe935548b3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23461a3d7ca49f6a77d3fde6f1009d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:43:28 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-480d5aed-38e5-47c8-8bc1-65efb0d03bb9 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd" status: 200 len: 1737 microversion: 2.1 time: 0.165885 Apr 11 15:43:28 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 257/773] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:43:28 2023] GET /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:43:32 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-ceb135b3-1000-4af2-bf99-ca1bf8267f9d req-29a89c68-0681-4e06-97a2-2a5ceec51538 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e816ce5-4da8-4366-9fa1-c33a45ba87fd", "name": "network-vif-unplugged", "status": "completed", "tag": "7f4d2694-64e4-4dd0-af87-84d67de89287"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:43:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-ceb135b3-1000-4af2-bf99-ca1bf8267f9d req-29a89c68-0681-4e06-97a2-2a5ceec51538 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-ceb135b3-1000-4af2-bf99-ca1bf8267f9d req-29a89c68-0681-4e06-97a2-2a5ceec51538 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-ceb135b3-1000-4af2-bf99-ca1bf8267f9d req-29a89c68-0681-4e06-97a2-2a5ceec51538 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:32 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-ceb135b3-1000-4af2-bf99-ca1bf8267f9d req-29a89c68-0681-4e06-97a2-2a5ceec51538 service nova] Creating event network-vif-unplugged:7f4d2694-64e4-4dd0-af87-84d67de89287 for instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd on user Apr 11 15:43:32 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-ceb135b3-1000-4af2-bf99-ca1bf8267f9d req-29a89c68-0681-4e06-97a2-2a5ceec51538 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030772 Apr 11 15:43:32 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 256/774] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:43:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:43:34 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e816ce5-4da8-4366-9fa1-c33a45ba87fd", "name": "network-vif-plugged", "status": "completed", "tag": "7f4d2694-64e4-4dd0-af87-84d67de89287"}, {"server_uuid": "8e816ce5-4da8-4366-9fa1-c33a45ba87fd", "name": "network-vif-plugged", "status": "completed", "tag": "7f4d2694-64e4-4dd0-af87-84d67de89287"}, {"server_uuid": "8e816ce5-4da8-4366-9fa1-c33a45ba87fd", "name": "network-vif-plugged", "status": "completed", "tag": "7f4d2694-64e4-4dd0-af87-84d67de89287"}, {"server_uuid": "8e816ce5-4da8-4366-9fa1-c33a45ba87fd", "name": "network-vif-unplugged", "status": "completed", "tag": "7f4d2694-64e4-4dd0-af87-84d67de89287"}, {"server_uuid": "8e816ce5-4da8-4366-9fa1-c33a45ba87fd", "name": "network-vif-plugged", "status": "completed", "tag": "7f4d2694-64e4-4dd0-af87-84d67de89287"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:43:34 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:34 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:34 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:34 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] Creating event network-vif-plugged:7f4d2694-64e4-4dd0-af87-84d67de89287 for instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd on user Apr 11 15:43:34 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] Creating event network-vif-plugged:7f4d2694-64e4-4dd0-af87-84d67de89287 for instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd on user Apr 11 15:43:34 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] Creating event network-vif-plugged:7f4d2694-64e4-4dd0-af87-84d67de89287 for instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd on user Apr 11 15:43:34 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] Creating event network-vif-unplugged:7f4d2694-64e4-4dd0-af87-84d67de89287 for instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd on user Apr 11 15:43:34 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] Creating event network-vif-plugged:7f4d2694-64e4-4dd0-af87-84d67de89287 for instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd on user Apr 11 15:43:34 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.046597 Apr 11 15:43:34 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 262/775] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:43:34 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:43:36 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-27b2e11e-357d-4504-a737-cd506c47a412 req-40eb2a5a-fc60-404f-8640-bc48420eed8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e816ce5-4da8-4366-9fa1-c33a45ba87fd", "name": "network-vif-plugged", "status": "completed", "tag": "7f4d2694-64e4-4dd0-af87-84d67de89287"}, {"server_uuid": "8e816ce5-4da8-4366-9fa1-c33a45ba87fd", "name": "network-vif-plugged", "status": "completed", "tag": "7f4d2694-64e4-4dd0-af87-84d67de89287"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:43:36 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-27b2e11e-357d-4504-a737-cd506c47a412 req-40eb2a5a-fc60-404f-8640-bc48420eed8f service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:36 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-27b2e11e-357d-4504-a737-cd506c47a412 req-40eb2a5a-fc60-404f-8640-bc48420eed8f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:36 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-27b2e11e-357d-4504-a737-cd506c47a412 req-40eb2a5a-fc60-404f-8640-bc48420eed8f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:36 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-27b2e11e-357d-4504-a737-cd506c47a412 req-40eb2a5a-fc60-404f-8640-bc48420eed8f service nova] Creating event network-vif-plugged:7f4d2694-64e4-4dd0-af87-84d67de89287 for instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd on user Apr 11 15:43:36 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-27b2e11e-357d-4504-a737-cd506c47a412 req-40eb2a5a-fc60-404f-8640-bc48420eed8f service nova] Creating event network-vif-plugged:7f4d2694-64e4-4dd0-af87-84d67de89287 for instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd on user Apr 11 15:43:36 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-27b2e11e-357d-4504-a737-cd506c47a412 req-40eb2a5a-fc60-404f-8640-bc48420eed8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036197 Apr 11 15:43:36 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 258/776] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:43:36 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:43:52 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:43:52 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:43:52 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:43:52 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:43:52 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:52 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:52 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:52 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:52 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:52 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:52 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Going to try to terminate instance {{(pid=61165) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:43:52 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4" status: 204 len: 0 microversion: 2.1 time: 0.166600 Apr 11 15:43:52 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 257/777] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:43:52 2023] DELETE /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:43:52 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=10 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:43:52 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:43:52 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-188bfb36-5859-4983-a82d-b09efdd390aa tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:43:52 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-188bfb36-5859-4983-a82d-b09efdd390aa tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:43:52 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-188bfb36-5859-4983-a82d-b09efdd390aa tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:52 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-188bfb36-5859-4983-a82d-b09efdd390aa tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:52 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-188bfb36-5859-4983-a82d-b09efdd390aa tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:52 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-188bfb36-5859-4983-a82d-b09efdd390aa tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:52 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-188bfb36-5859-4983-a82d-b09efdd390aa tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:52 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-188bfb36-5859-4983-a82d-b09efdd390aa tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:52 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-188bfb36-5859-4983-a82d-b09efdd390aa tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:43:52 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-188bfb36-5859-4983-a82d-b09efdd390aa tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4" status: 200 len: 1552 microversion: 2.1 time: 0.186284 Apr 11 15:43:52 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 263/778] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:43:52 2023] GET /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4 => generated 1552 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:43:52 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=10 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:43:52 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=28 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:43:52 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-8e40cddb-cbed-4a38-8d5e-c4fb5203de7d req-30f8400c-6d91-4eca-b0b4-258ac3e2b58c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffce2921-d4a5-4bcb-8032-62a6dc321fb4", "name": "network-vif-unplugged", "status": "completed", "tag": "910fb3d4-3965-41a2-8f97-9de79ee78c78"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:43:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-8e40cddb-cbed-4a38-8d5e-c4fb5203de7d req-30f8400c-6d91-4eca-b0b4-258ac3e2b58c service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-8e40cddb-cbed-4a38-8d5e-c4fb5203de7d req-30f8400c-6d91-4eca-b0b4-258ac3e2b58c service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-8e40cddb-cbed-4a38-8d5e-c4fb5203de7d req-30f8400c-6d91-4eca-b0b4-258ac3e2b58c service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:52 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-8e40cddb-cbed-4a38-8d5e-c4fb5203de7d req-30f8400c-6d91-4eca-b0b4-258ac3e2b58c service nova] Creating event network-vif-unplugged:910fb3d4-3965-41a2-8f97-9de79ee78c78 for instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 on user Apr 11 15:43:52 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-8e40cddb-cbed-4a38-8d5e-c4fb5203de7d req-30f8400c-6d91-4eca-b0b4-258ac3e2b58c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060766 Apr 11 15:43:52 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 259/779] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:43:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:43:54 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-84e8d2a0-1deb-4b58-848d-e404f9764276 req-01026e6a-1828-4906-b5df-2d10d96971b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffce2921-d4a5-4bcb-8032-62a6dc321fb4", "name": "network-vif-deleted", "tag": "910fb3d4-3965-41a2-8f97-9de79ee78c78"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:43:54 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-84e8d2a0-1deb-4b58-848d-e404f9764276 req-01026e6a-1828-4906-b5df-2d10d96971b5 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:54 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-84e8d2a0-1deb-4b58-848d-e404f9764276 req-01026e6a-1828-4906-b5df-2d10d96971b5 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:54 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-84e8d2a0-1deb-4b58-848d-e404f9764276 req-01026e6a-1828-4906-b5df-2d10d96971b5 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:54 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-84e8d2a0-1deb-4b58-848d-e404f9764276 req-01026e6a-1828-4906-b5df-2d10d96971b5 service nova] Creating event network-vif-deleted:910fb3d4-3965-41a2-8f97-9de79ee78c78 for instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 on user Apr 11 15:43:54 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-84e8d2a0-1deb-4b58-848d-e404f9764276 req-01026e6a-1828-4906-b5df-2d10d96971b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035602 Apr 11 15:43:54 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 258/780] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:43:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:43:54 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-0cdf54c3-bc7f-40d6-9bf2-ee165d1805bc req-7ccf93cc-7e7b-457f-8f77-2e7c90008ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffce2921-d4a5-4bcb-8032-62a6dc321fb4", "name": "network-vif-plugged", "status": "completed", "tag": "910fb3d4-3965-41a2-8f97-9de79ee78c78"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:43:54 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-0cdf54c3-bc7f-40d6-9bf2-ee165d1805bc req-7ccf93cc-7e7b-457f-8f77-2e7c90008ea4 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:43:54 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-0cdf54c3-bc7f-40d6-9bf2-ee165d1805bc req-7ccf93cc-7e7b-457f-8f77-2e7c90008ea4 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:43:54 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-0cdf54c3-bc7f-40d6-9bf2-ee165d1805bc req-7ccf93cc-7e7b-457f-8f77-2e7c90008ea4 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:43:54 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-0cdf54c3-bc7f-40d6-9bf2-ee165d1805bc req-7ccf93cc-7e7b-457f-8f77-2e7c90008ea4 service nova] Creating event network-vif-plugged:910fb3d4-3965-41a2-8f97-9de79ee78c78 for instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 on user Apr 11 15:43:54 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-0cdf54c3-bc7f-40d6-9bf2-ee165d1805bc req-7ccf93cc-7e7b-457f-8f77-2e7c90008ea4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035170 Apr 11 15:43:54 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 264/781] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:43:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:44:05 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:44:05 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:44:05 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-d027d81d-8bb4-44ba-b4aa-36d8dd38aa89 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:44:05 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-d027d81d-8bb4-44ba-b4aa-36d8dd38aa89 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:44:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d027d81d-8bb4-44ba-b4aa-36d8dd38aa89 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d027d81d-8bb4-44ba-b4aa-36d8dd38aa89 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d027d81d-8bb4-44ba-b4aa-36d8dd38aa89 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d027d81d-8bb4-44ba-b4aa-36d8dd38aa89 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d027d81d-8bb4-44ba-b4aa-36d8dd38aa89 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d027d81d-8bb4-44ba-b4aa-36d8dd38aa89 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:05 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-d027d81d-8bb4-44ba-b4aa-36d8dd38aa89 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2110b74f38642afa560e1c9790d3f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312851c65ba1434691eca0cd2a8cd6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:44:05 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-d027d81d-8bb4-44ba-b4aa-36d8dd38aa89 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f51cc22-e687-40e2-899a-72f2f169b154" status: 200 len: 1378 microversion: 2.1 time: 0.171722 Apr 11 15:44:05 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 260/782] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:44:05 2023] GET /compute/v2.1/servers/4f51cc22-e687-40e2-899a-72f2f169b154 => generated 1378 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:44:05 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:44:05 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:44:05 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-e6e680df-7e08-4e44-af7b-df03228ae80b tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:44:05 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-e6e680df-7e08-4e44-af7b-df03228ae80b tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:44:05 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e6e680df-7e08-4e44-af7b-df03228ae80b tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:05 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e6e680df-7e08-4e44-af7b-df03228ae80b tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:05 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e6e680df-7e08-4e44-af7b-df03228ae80b tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:05 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e6e680df-7e08-4e44-af7b-df03228ae80b tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:05 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e6e680df-7e08-4e44-af7b-df03228ae80b tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:05 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e6e680df-7e08-4e44-af7b-df03228ae80b tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:05 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-e6e680df-7e08-4e44-af7b-df03228ae80b tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2110b74f38642afa560e1c9790d3f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312851c65ba1434691eca0cd2a8cd6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:44:05 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-e6e680df-7e08-4e44-af7b-df03228ae80b tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f51cc22-e687-40e2-899a-72f2f169b154" status: 200 len: 1378 microversion: 2.1 time: 0.159166 Apr 11 15:44:05 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 259/783] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:44:05 2023] GET /compute/v2.1/servers/4f51cc22-e687-40e2-899a-72f2f169b154 => generated 1378 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:44:05 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=4 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:44:05 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=8 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:44:05 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:44:05 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:44:05 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:05 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:05 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:05 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:05 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:05 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:05 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Going to try to terminate instance {{(pid=61167) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:44:05 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4f51cc22-e687-40e2-899a-72f2f169b154" status: 204 len: 0 microversion: 2.1 time: 0.109119 Apr 11 15:44:05 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 265/784] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:44:05 2023] DELETE /compute/v2.1/servers/4f51cc22-e687-40e2-899a-72f2f169b154 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:44:05 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-99408a70-ff24-4645-91f9-184de430b73a tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:44:05 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-99408a70-ff24-4645-91f9-184de430b73a tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:44:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-99408a70-ff24-4645-91f9-184de430b73a tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-99408a70-ff24-4645-91f9-184de430b73a tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-99408a70-ff24-4645-91f9-184de430b73a tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-99408a70-ff24-4645-91f9-184de430b73a tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-99408a70-ff24-4645-91f9-184de430b73a tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-99408a70-ff24-4645-91f9-184de430b73a tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:05 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-99408a70-ff24-4645-91f9-184de430b73a tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2110b74f38642afa560e1c9790d3f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312851c65ba1434691eca0cd2a8cd6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:44:05 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-99408a70-ff24-4645-91f9-184de430b73a tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f51cc22-e687-40e2-899a-72f2f169b154" status: 200 len: 1384 microversion: 2.1 time: 0.158613 Apr 11 15:44:05 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 261/785] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:44:05 2023] GET /compute/v2.1/servers/4f51cc22-e687-40e2-899a-72f2f169b154 => generated 1384 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:44:06 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-592adfef-6b71-4e3b-afeb-6bf5512c77bc req-70c12964-8b4a-41a0-858c-548f708ef6e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f51cc22-e687-40e2-899a-72f2f169b154", "name": "network-vif-unplugged", "status": "completed", "tag": "66c0193e-7320-4344-8ef3-419b21bbbba7"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:44:06 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-592adfef-6b71-4e3b-afeb-6bf5512c77bc req-70c12964-8b4a-41a0-858c-548f708ef6e6 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:06 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-592adfef-6b71-4e3b-afeb-6bf5512c77bc req-70c12964-8b4a-41a0-858c-548f708ef6e6 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:06 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-592adfef-6b71-4e3b-afeb-6bf5512c77bc req-70c12964-8b4a-41a0-858c-548f708ef6e6 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:06 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-592adfef-6b71-4e3b-afeb-6bf5512c77bc req-70c12964-8b4a-41a0-858c-548f708ef6e6 service nova] Creating event network-vif-unplugged:66c0193e-7320-4344-8ef3-419b21bbbba7 for instance 4f51cc22-e687-40e2-899a-72f2f169b154 on user Apr 11 15:44:06 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-592adfef-6b71-4e3b-afeb-6bf5512c77bc req-70c12964-8b4a-41a0-858c-548f708ef6e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028938 Apr 11 15:44:06 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 260/786] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:44:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:44:07 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-52e52f5c-2716-4348-b82a-9950ee63644d req-8710c892-073c-4ed3-8221-186dc694cabb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f51cc22-e687-40e2-899a-72f2f169b154", "name": "network-vif-deleted", "tag": "66c0193e-7320-4344-8ef3-419b21bbbba7"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:44:07 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-52e52f5c-2716-4348-b82a-9950ee63644d req-8710c892-073c-4ed3-8221-186dc694cabb service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:07 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-52e52f5c-2716-4348-b82a-9950ee63644d req-8710c892-073c-4ed3-8221-186dc694cabb service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:07 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-52e52f5c-2716-4348-b82a-9950ee63644d req-8710c892-073c-4ed3-8221-186dc694cabb service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:07 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-52e52f5c-2716-4348-b82a-9950ee63644d req-8710c892-073c-4ed3-8221-186dc694cabb service nova] Creating event network-vif-deleted:66c0193e-7320-4344-8ef3-419b21bbbba7 for instance 4f51cc22-e687-40e2-899a-72f2f169b154 on user Apr 11 15:44:07 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-52e52f5c-2716-4348-b82a-9950ee63644d req-8710c892-073c-4ed3-8221-186dc694cabb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030000 Apr 11 15:44:07 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 266/787] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:44:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 15:44:08 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-0744d034-2256-4947-b77d-1a14291a76b5 req-0f7c478c-ca73-44f4-8e00-272a776765ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f51cc22-e687-40e2-899a-72f2f169b154", "name": "network-vif-plugged", "status": "completed", "tag": "66c0193e-7320-4344-8ef3-419b21bbbba7"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:44:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-0744d034-2256-4947-b77d-1a14291a76b5 req-0f7c478c-ca73-44f4-8e00-272a776765ca service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-0744d034-2256-4947-b77d-1a14291a76b5 req-0f7c478c-ca73-44f4-8e00-272a776765ca service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-0744d034-2256-4947-b77d-1a14291a76b5 req-0f7c478c-ca73-44f4-8e00-272a776765ca service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:08 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-0744d034-2256-4947-b77d-1a14291a76b5 req-0f7c478c-ca73-44f4-8e00-272a776765ca service nova] Creating event network-vif-plugged:66c0193e-7320-4344-8ef3-419b21bbbba7 for instance 4f51cc22-e687-40e2-899a-72f2f169b154 on user Apr 11 15:44:08 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-0744d034-2256-4947-b77d-1a14291a76b5 req-0f7c478c-ca73-44f4-8e00-272a776765ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037320 Apr 11 15:44:08 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 262/788] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:44:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 15:44:17 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:44:17 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=8 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:44:17 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-f51d170c-8177-42ca-8dc6-b701bc75c9fc tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Action: 'create', calling method: .version_select at 0x7f4c2eca8ee0>, body: {"keypair": {"name": "tempest-keypair-1367691795", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPYdVbZDtC1igDufA6PhMZJpvm+SfaXlWlDTwlgCYAsIhgsTCFIatXSmQzAx4qEEtvrM9m6Ml8tgUz/SNa6YjJmdUHImSQvQGbvvCZehYMuZMwW6pbpX8JfbeU5smcaBw=="}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:44:17 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-f51d170c-8177-42ca-8dc6-b701bc75c9fc tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Getting quotas for project d700a53aa25849e0afd562b05881d09a. Resources: {'key_pairs'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:44:17 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-f51d170c-8177-42ca-8dc6-b701bc75c9fc tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Getting quotas for user 5c8492f96e5d4f54aaae3679c82b6759 and project d700a53aa25849e0afd562b05881d09a. Resources: {'key_pairs'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:44:17 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-f51d170c-8177-42ca-8dc6-b701bc75c9fc tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053285 Apr 11 15:44:17 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 261/789] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 15:44:17 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:44:19 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:44:19 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:44:19 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-d4f9ac41-0213-4fc4-81c8-8f4ae8fc9189 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:44:19 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-d4f9ac41-0213-4fc4-81c8-8f4ae8fc9189 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:44:19 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d4f9ac41-0213-4fc4-81c8-8f4ae8fc9189 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:19 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d4f9ac41-0213-4fc4-81c8-8f4ae8fc9189 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:19 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d4f9ac41-0213-4fc4-81c8-8f4ae8fc9189 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:19 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d4f9ac41-0213-4fc4-81c8-8f4ae8fc9189 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:19 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d4f9ac41-0213-4fc4-81c8-8f4ae8fc9189 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:19 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d4f9ac41-0213-4fc4-81c8-8f4ae8fc9189 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:19 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-d4f9ac41-0213-4fc4-81c8-8f4ae8fc9189 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044f17aee3324b3a97bebe935548b3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23461a3d7ca49f6a77d3fde6f1009d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:44:19 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-d4f9ac41-0213-4fc4-81c8-8f4ae8fc9189 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd" status: 200 len: 1745 microversion: 2.1 time: 0.255888 Apr 11 15:44:19 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 267/790] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:44:19 2023] GET /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd => generated 1745 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:44:19 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:44:19 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=14 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:44:19 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1921913590", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "7ba20249-9c62-46d7-810c-8144c1a1f17e"}], "security_groups": [{"name": "tempest-securitygroup--1255836429"}], "key_name": "tempest-keypair-1367691795", "user_data": "}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:44:19 user devstack@n-api.service[61166]: DEBUG nova.network.neutron [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] validate_networks() for [('7ba20249-9c62-46d7-810c-8144c1a1f17e', None, None, None, None, None)] {{(pid=61166) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:44:19 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Flavor limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:44:19 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Image limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:44:19 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Flavor pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:44:19 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Image pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:44:19 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:44:20 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:20 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:20 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:20 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:20 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:20 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:20 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Getting quotas for project d700a53aa25849e0afd562b05881d09a. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:44:20 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Getting quotas for user 5c8492f96e5d4f54aaae3679c82b6759 and project d700a53aa25849e0afd562b05881d09a. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:44:20 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Going to run 1 instances... {{(pid=61166) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:44:20 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52fe638c-5ada-47d5-b376-233bfa808a37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:44:20 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.593664 Apr 11 15:44:20 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 263/791] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 15:44:19 2023] POST /compute/v2.1/servers => generated 407 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 15:44:20 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-677648b7-bb4f-4f24-b7e1-db3fd303542d tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:44:20 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-677648b7-bb4f-4f24-b7e1-db3fd303542d tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:44:20 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-677648b7-bb4f-4f24-b7e1-db3fd303542d tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8492f96e5d4f54aaae3679c82b6759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd700a53aa25849e0afd562b05881d09a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:44:20 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-677648b7-bb4f-4f24-b7e1-db3fd303542d tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" status: 200 len: 1240 microversion: 2.1 time: 0.070361 Apr 11 15:44:20 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 262/792] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:44:20 2023] GET /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:44:22 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-8d06e4ac-ef49-4b32-af0b-6b2bd71765c5 req-4f1e6b7e-4469-44d3-8c14-03709cb6dcda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a", "tag": "35ac8f6f-2998-4274-ab63-df7086194703"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:44:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-8d06e4ac-ef49-4b32-af0b-6b2bd71765c5 req-4f1e6b7e-4469-44d3-8c14-03709cb6dcda service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-8d06e4ac-ef49-4b32-af0b-6b2bd71765c5 req-4f1e6b7e-4469-44d3-8c14-03709cb6dcda service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-8d06e4ac-ef49-4b32-af0b-6b2bd71765c5 req-4f1e6b7e-4469-44d3-8c14-03709cb6dcda service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:22 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-8d06e4ac-ef49-4b32-af0b-6b2bd71765c5 req-4f1e6b7e-4469-44d3-8c14-03709cb6dcda service nova] Creating event network-changed:35ac8f6f-2998-4274-ab63-df7086194703 for instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a on user Apr 11 15:44:22 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-8d06e4ac-ef49-4b32-af0b-6b2bd71765c5 req-4f1e6b7e-4469-44d3-8c14-03709cb6dcda service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045217 Apr 11 15:44:22 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 268/793] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:44:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:44:24 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-75a25abd-7a0a-4820-b1ae-62793be0dcd2 req-55d1f788-b80b-43df-ae4f-a30ce0875c2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a", "name": "network-vif-plugged", "status": "completed", "tag": "35ac8f6f-2998-4274-ab63-df7086194703"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:44:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-75a25abd-7a0a-4820-b1ae-62793be0dcd2 req-55d1f788-b80b-43df-ae4f-a30ce0875c2e service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-75a25abd-7a0a-4820-b1ae-62793be0dcd2 req-55d1f788-b80b-43df-ae4f-a30ce0875c2e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-75a25abd-7a0a-4820-b1ae-62793be0dcd2 req-55d1f788-b80b-43df-ae4f-a30ce0875c2e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:25 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-75a25abd-7a0a-4820-b1ae-62793be0dcd2 req-55d1f788-b80b-43df-ae4f-a30ce0875c2e service nova] Creating event network-vif-plugged:35ac8f6f-2998-4274-ab63-df7086194703 for instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a on user Apr 11 15:44:25 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-75a25abd-7a0a-4820-b1ae-62793be0dcd2 req-55d1f788-b80b-43df-ae4f-a30ce0875c2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043213 Apr 11 15:44:25 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 264/794] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:44:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:44:27 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-1ae1628d-b107-405d-bcab-5b1822bb9f8a req-2e336834-82e9-4188-b953-396a0904f55e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a", "name": "network-vif-plugged", "status": "completed", "tag": "35ac8f6f-2998-4274-ab63-df7086194703"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:44:27 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-1ae1628d-b107-405d-bcab-5b1822bb9f8a req-2e336834-82e9-4188-b953-396a0904f55e service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:27 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-1ae1628d-b107-405d-bcab-5b1822bb9f8a req-2e336834-82e9-4188-b953-396a0904f55e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:27 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-1ae1628d-b107-405d-bcab-5b1822bb9f8a req-2e336834-82e9-4188-b953-396a0904f55e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:27 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-1ae1628d-b107-405d-bcab-5b1822bb9f8a req-2e336834-82e9-4188-b953-396a0904f55e service nova] Creating event network-vif-plugged:35ac8f6f-2998-4274-ab63-df7086194703 for instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a on user Apr 11 15:44:27 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-1ae1628d-b107-405d-bcab-5b1822bb9f8a req-2e336834-82e9-4188-b953-396a0904f55e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029326 Apr 11 15:44:27 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 263/795] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:44:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:44:42 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=4 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:44:42 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=8 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:44:42 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-00c7181b-d47a-4b09-abc0-8eeae7bb349f tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:44:42 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-00c7181b-d47a-4b09-abc0-8eeae7bb349f tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:44:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-00c7181b-d47a-4b09-abc0-8eeae7bb349f tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-00c7181b-d47a-4b09-abc0-8eeae7bb349f tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-00c7181b-d47a-4b09-abc0-8eeae7bb349f tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-00c7181b-d47a-4b09-abc0-8eeae7bb349f tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-00c7181b-d47a-4b09-abc0-8eeae7bb349f tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-00c7181b-d47a-4b09-abc0-8eeae7bb349f tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:42 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-00c7181b-d47a-4b09-abc0-8eeae7bb349f tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] HTTP exception thrown: Instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 could not be found. Apr 11 15:44:42 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-00c7181b-d47a-4b09-abc0-8eeae7bb349f tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Request method failure captured: Apr 11 15:44:42 user devstack@n-api.service[61167]: request: GET /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4 HTTP/1.1 Apr 11 15:44:42 user devstack@n-api.service[61167]: Accept: application/json Apr 11 15:44:42 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 15:44:42 user devstack@n-api.service[61167]: Connection: close Apr 11 15:44:42 user devstack@n-api.service[61167]: Content-Length: 0 Apr 11 15:44:42 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 15:44:42 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 15:44:42 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 15:44:42 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 15:44:42 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNXrYvI576bfomvCXZOrRtX3e2WmI0QGGCZ-UwRPLPuWgxsvMU36nQ66FN0clBQeDihHABwOLAnAowbsIYeSiNwDxFudaK_nP7q4dDBOqIbmzwyfS5wL-Xwj8ivjkgXoPykYGSjyYhQcHlwVjZYOpOkrwJAeWupSEmtcb6WkxeGjFduc Apr 11 15:44:42 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 15:44:42 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 15:44:42 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 15:44:42 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 15:44:42 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 15:44:42 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 15:44:42 user devstack@n-api.service[61167]: X-Project-Id: bb7660e8f76b471487136806ee9eec62 Apr 11 15:44:42 user devstack@n-api.service[61167]: X-Project-Name: tempest-ServerActionsTestJSON-1659503440 Apr 11 15:44:42 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 15:44:42 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 15:44:42 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb7660e8f76b471487136806ee9eec62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bb7660e8f76b471487136806ee9eec62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb7660e8f76b471487136806ee9eec62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:44:42 user devstack@n-api.service[61167]: X-Tenant: tempest-ServerActionsTestJSON-1659503440 Apr 11 15:44:42 user devstack@n-api.service[61167]: X-Tenant-Id: bb7660e8f76b471487136806ee9eec62 Apr 11 15:44:42 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-ServerActionsTestJSON-1659503440 Apr 11 15:44:42 user devstack@n-api.service[61167]: X-User: tempest-ServerActionsTestJSON-1659503440-project-member Apr 11 15:44:42 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 15:44:42 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 15:44:42 user devstack@n-api.service[61167]: X-User-Id: 10720df0ac4f4e62a0a5c9883d600add Apr 11 15:44:42 user devstack@n-api.service[61167]: X-User-Name: tempest-ServerActionsTestJSON-1659503440-project-member Apr 11 15:44:42 user devstack@n-api.service[61167]: method: > Apr 11 15:44:42 user devstack@n-api.service[61167]: exception: Instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 could not be found. Apr 11 15:44:42 user devstack@n-api.service[61167]: action_args: {'id': 'ffce2921-d4a5-4bcb-8032-62a6dc321fb4'} Apr 11 15:44:42 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 could not be found. Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 could not be found. Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 could not be found. Apr 11 15:44:42 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:44:42 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-00c7181b-d47a-4b09-abc0-8eeae7bb349f tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Returning 404 to user: Instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 could not be found. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:44:42 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-00c7181b-d47a-4b09-abc0-8eeae7bb349f tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4" status: 404 len: 111 microversion: 2.1 time: 0.032547 Apr 11 15:44:42 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 269/796] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:44:42 2023] GET /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:44:42 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:44:42 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:44:42 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:44:42 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:44:42 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-91013018-1aaf-49d6-b3bc-76baa3d0076c tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:44:42 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-91013018-1aaf-49d6-b3bc-76baa3d0076c tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:44:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-91013018-1aaf-49d6-b3bc-76baa3d0076c tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-91013018-1aaf-49d6-b3bc-76baa3d0076c tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-91013018-1aaf-49d6-b3bc-76baa3d0076c tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-91013018-1aaf-49d6-b3bc-76baa3d0076c tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-91013018-1aaf-49d6-b3bc-76baa3d0076c tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-91013018-1aaf-49d6-b3bc-76baa3d0076c tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:42 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-91013018-1aaf-49d6-b3bc-76baa3d0076c tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] HTTP exception thrown: Instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 could not be found. Apr 11 15:44:42 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-91013018-1aaf-49d6-b3bc-76baa3d0076c tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Request method failure captured: Apr 11 15:44:42 user devstack@n-api.service[61166]: request: DELETE /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4 HTTP/1.1 Apr 11 15:44:42 user devstack@n-api.service[61166]: Accept: application/json Apr 11 15:44:42 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 15:44:42 user devstack@n-api.service[61166]: Connection: close Apr 11 15:44:42 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 15:44:42 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 15:44:42 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 15:44:42 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 15:44:42 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 15:44:42 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNXrYvI576bfomvCXZOrRtX3e2WmI0QGGCZ-UwRPLPuWgxsvMU36nQ66FN0clBQeDihHABwOLAnAowbsIYeSiNwDxFudaK_nP7q4dDBOqIbmzwyfS5wL-Xwj8ivjkgXoPykYGSjyYhQcHlwVjZYOpOkrwJAeWupSEmtcb6WkxeGjFduc Apr 11 15:44:42 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 15:44:42 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 15:44:42 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 15:44:42 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 15:44:42 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 15:44:42 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 15:44:42 user devstack@n-api.service[61166]: X-Project-Id: bb7660e8f76b471487136806ee9eec62 Apr 11 15:44:42 user devstack@n-api.service[61166]: X-Project-Name: tempest-ServerActionsTestJSON-1659503440 Apr 11 15:44:42 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 15:44:42 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 15:44:42 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb7660e8f76b471487136806ee9eec62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bb7660e8f76b471487136806ee9eec62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb7660e8f76b471487136806ee9eec62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:44:42 user devstack@n-api.service[61166]: X-Tenant: tempest-ServerActionsTestJSON-1659503440 Apr 11 15:44:42 user devstack@n-api.service[61166]: X-Tenant-Id: bb7660e8f76b471487136806ee9eec62 Apr 11 15:44:42 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-ServerActionsTestJSON-1659503440 Apr 11 15:44:42 user devstack@n-api.service[61166]: X-User: tempest-ServerActionsTestJSON-1659503440-project-member Apr 11 15:44:42 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 15:44:42 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 15:44:42 user devstack@n-api.service[61166]: X-User-Id: 10720df0ac4f4e62a0a5c9883d600add Apr 11 15:44:42 user devstack@n-api.service[61166]: X-User-Name: tempest-ServerActionsTestJSON-1659503440-project-member Apr 11 15:44:42 user devstack@n-api.service[61166]: method: > Apr 11 15:44:42 user devstack@n-api.service[61166]: exception: Instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 could not be found. Apr 11 15:44:42 user devstack@n-api.service[61166]: action_args: {'id': 'ffce2921-d4a5-4bcb-8032-62a6dc321fb4'} Apr 11 15:44:42 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 could not be found. Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 could not be found. Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 could not be found. Apr 11 15:44:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:44:42 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-91013018-1aaf-49d6-b3bc-76baa3d0076c tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Returning 404 to user: Instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 could not be found. {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:44:42 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-91013018-1aaf-49d6-b3bc-76baa3d0076c tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4" status: 404 len: 111 microversion: 2.1 time: 0.038893 Apr 11 15:44:42 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 265/797] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:44:42 2023] DELETE /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:44:42 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:44:42 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:44:42 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:44:42 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-fc73eace-7ea2-45b3-b8e9-09b79a2b4cee tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:44:42 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-fc73eace-7ea2-45b3-b8e9-09b79a2b4cee tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:44:42 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-fc73eace-7ea2-45b3-b8e9-09b79a2b4cee tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:42 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-fc73eace-7ea2-45b3-b8e9-09b79a2b4cee tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:42 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-fc73eace-7ea2-45b3-b8e9-09b79a2b4cee tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:42 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-fc73eace-7ea2-45b3-b8e9-09b79a2b4cee tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:42 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-fc73eace-7ea2-45b3-b8e9-09b79a2b4cee tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:42 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-fc73eace-7ea2-45b3-b8e9-09b79a2b4cee tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:42 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-fc73eace-7ea2-45b3-b8e9-09b79a2b4cee tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] HTTP exception thrown: Instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 could not be found. Apr 11 15:44:42 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-fc73eace-7ea2-45b3-b8e9-09b79a2b4cee tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Request method failure captured: Apr 11 15:44:42 user devstack@n-api.service[61165]: request: GET /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4 HTTP/1.1 Apr 11 15:44:42 user devstack@n-api.service[61165]: Accept: application/json Apr 11 15:44:42 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 15:44:42 user devstack@n-api.service[61165]: Connection: close Apr 11 15:44:42 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 15:44:42 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 15:44:42 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 15:44:42 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 15:44:42 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 15:44:42 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNXrYvI576bfomvCXZOrRtX3e2WmI0QGGCZ-UwRPLPuWgxsvMU36nQ66FN0clBQeDihHABwOLAnAowbsIYeSiNwDxFudaK_nP7q4dDBOqIbmzwyfS5wL-Xwj8ivjkgXoPykYGSjyYhQcHlwVjZYOpOkrwJAeWupSEmtcb6WkxeGjFduc Apr 11 15:44:42 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 15:44:42 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 15:44:42 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 15:44:42 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 15:44:42 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 15:44:42 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 15:44:42 user devstack@n-api.service[61165]: X-Project-Id: bb7660e8f76b471487136806ee9eec62 Apr 11 15:44:42 user devstack@n-api.service[61165]: X-Project-Name: tempest-ServerActionsTestJSON-1659503440 Apr 11 15:44:42 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 15:44:42 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 15:44:42 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb7660e8f76b471487136806ee9eec62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bb7660e8f76b471487136806ee9eec62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb7660e8f76b471487136806ee9eec62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:44:42 user devstack@n-api.service[61165]: X-Tenant: tempest-ServerActionsTestJSON-1659503440 Apr 11 15:44:42 user devstack@n-api.service[61165]: X-Tenant-Id: bb7660e8f76b471487136806ee9eec62 Apr 11 15:44:42 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-ServerActionsTestJSON-1659503440 Apr 11 15:44:42 user devstack@n-api.service[61165]: X-User: tempest-ServerActionsTestJSON-1659503440-project-member Apr 11 15:44:42 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 15:44:42 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 15:44:42 user devstack@n-api.service[61165]: X-User-Id: 10720df0ac4f4e62a0a5c9883d600add Apr 11 15:44:42 user devstack@n-api.service[61165]: X-User-Name: tempest-ServerActionsTestJSON-1659503440-project-member Apr 11 15:44:42 user devstack@n-api.service[61165]: method: > Apr 11 15:44:42 user devstack@n-api.service[61165]: exception: Instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 could not be found. Apr 11 15:44:42 user devstack@n-api.service[61165]: action_args: {'id': 'ffce2921-d4a5-4bcb-8032-62a6dc321fb4'} Apr 11 15:44:42 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 could not be found. Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 could not be found. Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 could not be found. Apr 11 15:44:42 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:44:42 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-fc73eace-7ea2-45b3-b8e9-09b79a2b4cee tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Returning 404 to user: Instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:44:42 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-fc73eace-7ea2-45b3-b8e9-09b79a2b4cee tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4" status: 404 len: 111 microversion: 2.1 time: 0.037373 Apr 11 15:44:42 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 264/798] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:44:42 2023] GET /compute/v2.1/servers/ffce2921-d4a5-4bcb-8032-62a6dc321fb4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:44:42 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:44:42 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:44:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:42 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Going to try to terminate instance {{(pid=61167) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:44:42 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e" status: 204 len: 0 microversion: 2.1 time: 0.108880 Apr 11 15:44:42 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 270/799] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:44:42 2023] DELETE /compute/v2.1/servers/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:44:42 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-622fe919-a90c-48d5-8ac9-505163abe89a tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:44:42 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-622fe919-a90c-48d5-8ac9-505163abe89a tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:44:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-622fe919-a90c-48d5-8ac9-505163abe89a tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-622fe919-a90c-48d5-8ac9-505163abe89a tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-622fe919-a90c-48d5-8ac9-505163abe89a tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-622fe919-a90c-48d5-8ac9-505163abe89a tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-622fe919-a90c-48d5-8ac9-505163abe89a tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-622fe919-a90c-48d5-8ac9-505163abe89a tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:43 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-622fe919-a90c-48d5-8ac9-505163abe89a tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:44:43 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-622fe919-a90c-48d5-8ac9-505163abe89a tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e" status: 200 len: 1546 microversion: 2.1 time: 0.192938 Apr 11 15:44:43 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 266/800] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:44:42 2023] GET /compute/v2.1/servers/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e => generated 1546 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:44:43 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-ed0d8361-d206-46fe-b6e1-63386c0b9945 req-51d463aa-07df-462d-b46d-027e7e706e90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcbfcbfd-7e96-4271-94ee-60ef937e3b7e", "name": "network-vif-unplugged", "status": "completed", "tag": "32c006ee-14e2-47d8-b999-bafc729aa67a"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:44:43 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-ed0d8361-d206-46fe-b6e1-63386c0b9945 req-51d463aa-07df-462d-b46d-027e7e706e90 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:43 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-ed0d8361-d206-46fe-b6e1-63386c0b9945 req-51d463aa-07df-462d-b46d-027e7e706e90 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:43 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-ed0d8361-d206-46fe-b6e1-63386c0b9945 req-51d463aa-07df-462d-b46d-027e7e706e90 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:43 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-ed0d8361-d206-46fe-b6e1-63386c0b9945 req-51d463aa-07df-462d-b46d-027e7e706e90 service nova] Creating event network-vif-unplugged:32c006ee-14e2-47d8-b999-bafc729aa67a for instance dcbfcbfd-7e96-4271-94ee-60ef937e3b7e on user Apr 11 15:44:43 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-ed0d8361-d206-46fe-b6e1-63386c0b9945 req-51d463aa-07df-462d-b46d-027e7e706e90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034846 Apr 11 15:44:43 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 265/801] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:44:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:44:44 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-78f49594-b491-4ea6-b7b4-e6cb4c3b7e9f req-d69e6fb5-bcee-4e77-8f09-dee211d2c27f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcbfcbfd-7e96-4271-94ee-60ef937e3b7e", "name": "network-vif-deleted", "tag": "32c006ee-14e2-47d8-b999-bafc729aa67a"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:44:44 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-78f49594-b491-4ea6-b7b4-e6cb4c3b7e9f req-d69e6fb5-bcee-4e77-8f09-dee211d2c27f service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:44 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-78f49594-b491-4ea6-b7b4-e6cb4c3b7e9f req-d69e6fb5-bcee-4e77-8f09-dee211d2c27f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:44 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-78f49594-b491-4ea6-b7b4-e6cb4c3b7e9f req-d69e6fb5-bcee-4e77-8f09-dee211d2c27f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:44 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-78f49594-b491-4ea6-b7b4-e6cb4c3b7e9f req-d69e6fb5-bcee-4e77-8f09-dee211d2c27f service nova] Creating event network-vif-deleted:32c006ee-14e2-47d8-b999-bafc729aa67a for instance dcbfcbfd-7e96-4271-94ee-60ef937e3b7e on user Apr 11 15:44:44 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-78f49594-b491-4ea6-b7b4-e6cb4c3b7e9f req-d69e6fb5-bcee-4e77-8f09-dee211d2c27f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028162 Apr 11 15:44:44 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 271/802] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:44:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:44:45 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-f0673460-790e-47b9-ba6e-904eb30f61c1 req-4f97f67a-e3f2-4838-98e8-ea73e4c37c3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcbfcbfd-7e96-4271-94ee-60ef937e3b7e", "name": "network-vif-plugged", "status": "completed", "tag": "32c006ee-14e2-47d8-b999-bafc729aa67a"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:44:45 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-f0673460-790e-47b9-ba6e-904eb30f61c1 req-4f97f67a-e3f2-4838-98e8-ea73e4c37c3c service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:45 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-f0673460-790e-47b9-ba6e-904eb30f61c1 req-4f97f67a-e3f2-4838-98e8-ea73e4c37c3c service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:45 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-f0673460-790e-47b9-ba6e-904eb30f61c1 req-4f97f67a-e3f2-4838-98e8-ea73e4c37c3c service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:45 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-f0673460-790e-47b9-ba6e-904eb30f61c1 req-4f97f67a-e3f2-4838-98e8-ea73e4c37c3c service nova] Creating event network-vif-plugged:32c006ee-14e2-47d8-b999-bafc729aa67a for instance dcbfcbfd-7e96-4271-94ee-60ef937e3b7e on user Apr 11 15:44:45 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-f0673460-790e-47b9-ba6e-904eb30f61c1 req-4f97f67a-e3f2-4838-98e8-ea73e4c37c3c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031755 Apr 11 15:44:45 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 267/803] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:44:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:44:55 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:44:55 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:44:55 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-4257db00-3d4e-4176-a048-d7d591e680f4 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:44:55 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-4257db00-3d4e-4176-a048-d7d591e680f4 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:44:55 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4257db00-3d4e-4176-a048-d7d591e680f4 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:55 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4257db00-3d4e-4176-a048-d7d591e680f4 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:55 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4257db00-3d4e-4176-a048-d7d591e680f4 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:55 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4257db00-3d4e-4176-a048-d7d591e680f4 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:55 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4257db00-3d4e-4176-a048-d7d591e680f4 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:55 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4257db00-3d4e-4176-a048-d7d591e680f4 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:56 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-4257db00-3d4e-4176-a048-d7d591e680f4 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] HTTP exception thrown: Instance 4f51cc22-e687-40e2-899a-72f2f169b154 could not be found. Apr 11 15:44:56 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-4257db00-3d4e-4176-a048-d7d591e680f4 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Request method failure captured: Apr 11 15:44:56 user devstack@n-api.service[61165]: request: GET /compute/v2.1/servers/4f51cc22-e687-40e2-899a-72f2f169b154 HTTP/1.1 Apr 11 15:44:56 user devstack@n-api.service[61165]: Accept: application/json Apr 11 15:44:56 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 15:44:56 user devstack@n-api.service[61165]: Connection: close Apr 11 15:44:56 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 15:44:56 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 15:44:56 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 15:44:56 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 15:44:56 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 15:44:56 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNX_MfySgeWQGetehYkoHqYg1G1945hTNCEJ0iZ6MzpnT3yZAJa_LjZxGoo77mYeoWNM22txPKHxqCAJQHMF1JaEqPSco0vUdydRE47pwKZna0AOIEDnSU3nak09PN7xX11kpifNQbUB7HIx3dygnGm9WJh4EQWIeaVGEcb-QhV49Vog Apr 11 15:44:56 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 15:44:56 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 15:44:56 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 15:44:56 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 15:44:56 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 15:44:56 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 15:44:56 user devstack@n-api.service[61165]: X-Project-Id: 312851c65ba1434691eca0cd2a8cd6d2 Apr 11 15:44:56 user devstack@n-api.service[61165]: X-Project-Name: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:44:56 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 15:44:56 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 15:44:56 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:44:56 user devstack@n-api.service[61165]: X-Tenant: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:44:56 user devstack@n-api.service[61165]: X-Tenant-Id: 312851c65ba1434691eca0cd2a8cd6d2 Apr 11 15:44:56 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:44:56 user devstack@n-api.service[61165]: X-User: tempest-TestVolumeBootPattern-1933582504-project-member Apr 11 15:44:56 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 15:44:56 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 15:44:56 user devstack@n-api.service[61165]: X-User-Id: c2110b74f38642afa560e1c9790d3f81 Apr 11 15:44:56 user devstack@n-api.service[61165]: X-User-Name: tempest-TestVolumeBootPattern-1933582504-project-member Apr 11 15:44:56 user devstack@n-api.service[61165]: method: > Apr 11 15:44:56 user devstack@n-api.service[61165]: exception: Instance 4f51cc22-e687-40e2-899a-72f2f169b154 could not be found. Apr 11 15:44:56 user devstack@n-api.service[61165]: action_args: {'id': '4f51cc22-e687-40e2-899a-72f2f169b154'} Apr 11 15:44:56 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f51cc22-e687-40e2-899a-72f2f169b154 could not be found. Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f51cc22-e687-40e2-899a-72f2f169b154 could not be found. Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f51cc22-e687-40e2-899a-72f2f169b154 could not be found. Apr 11 15:44:56 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:44:56 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-4257db00-3d4e-4176-a048-d7d591e680f4 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Returning 404 to user: Instance 4f51cc22-e687-40e2-899a-72f2f169b154 could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:44:56 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-4257db00-3d4e-4176-a048-d7d591e680f4 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f51cc22-e687-40e2-899a-72f2f169b154" status: 404 len: 111 microversion: 2.1 time: 0.033370 Apr 11 15:44:56 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 266/804] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:44:55 2023] GET /compute/v2.1/servers/4f51cc22-e687-40e2-899a-72f2f169b154 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:44:56 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:44:56 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:44:56 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-4e96b25e-9ec3-4b97-9607-a7e6308a43b3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:44:56 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-4e96b25e-9ec3-4b97-9607-a7e6308a43b3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:44:56 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4e96b25e-9ec3-4b97-9607-a7e6308a43b3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:56 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4e96b25e-9ec3-4b97-9607-a7e6308a43b3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:56 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4e96b25e-9ec3-4b97-9607-a7e6308a43b3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:56 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4e96b25e-9ec3-4b97-9607-a7e6308a43b3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:56 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4e96b25e-9ec3-4b97-9607-a7e6308a43b3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:56 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4e96b25e-9ec3-4b97-9607-a7e6308a43b3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:56 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-4e96b25e-9ec3-4b97-9607-a7e6308a43b3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] HTTP exception thrown: Instance 4f51cc22-e687-40e2-899a-72f2f169b154 could not be found. Apr 11 15:44:56 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-4e96b25e-9ec3-4b97-9607-a7e6308a43b3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Request method failure captured: Apr 11 15:44:56 user devstack@n-api.service[61167]: request: DELETE /compute/v2.1/servers/4f51cc22-e687-40e2-899a-72f2f169b154 HTTP/1.1 Apr 11 15:44:56 user devstack@n-api.service[61167]: Accept: application/json Apr 11 15:44:56 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 15:44:56 user devstack@n-api.service[61167]: Connection: close Apr 11 15:44:56 user devstack@n-api.service[61167]: Content-Length: 0 Apr 11 15:44:56 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 15:44:56 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 15:44:56 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 15:44:56 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 15:44:56 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNX_MfySgeWQGetehYkoHqYg1G1945hTNCEJ0iZ6MzpnT3yZAJa_LjZxGoo77mYeoWNM22txPKHxqCAJQHMF1JaEqPSco0vUdydRE47pwKZna0AOIEDnSU3nak09PN7xX11kpifNQbUB7HIx3dygnGm9WJh4EQWIeaVGEcb-QhV49Vog Apr 11 15:44:56 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 15:44:56 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 15:44:56 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 15:44:56 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 15:44:56 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 15:44:56 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 15:44:56 user devstack@n-api.service[61167]: X-Project-Id: 312851c65ba1434691eca0cd2a8cd6d2 Apr 11 15:44:56 user devstack@n-api.service[61167]: X-Project-Name: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:44:56 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 15:44:56 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 15:44:56 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:44:56 user devstack@n-api.service[61167]: X-Tenant: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:44:56 user devstack@n-api.service[61167]: X-Tenant-Id: 312851c65ba1434691eca0cd2a8cd6d2 Apr 11 15:44:56 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:44:56 user devstack@n-api.service[61167]: X-User: tempest-TestVolumeBootPattern-1933582504-project-member Apr 11 15:44:56 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 15:44:56 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 15:44:56 user devstack@n-api.service[61167]: X-User-Id: c2110b74f38642afa560e1c9790d3f81 Apr 11 15:44:56 user devstack@n-api.service[61167]: X-User-Name: tempest-TestVolumeBootPattern-1933582504-project-member Apr 11 15:44:56 user devstack@n-api.service[61167]: method: > Apr 11 15:44:56 user devstack@n-api.service[61167]: exception: Instance 4f51cc22-e687-40e2-899a-72f2f169b154 could not be found. Apr 11 15:44:56 user devstack@n-api.service[61167]: action_args: {'id': '4f51cc22-e687-40e2-899a-72f2f169b154'} Apr 11 15:44:56 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f51cc22-e687-40e2-899a-72f2f169b154 could not be found. Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f51cc22-e687-40e2-899a-72f2f169b154 could not be found. Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f51cc22-e687-40e2-899a-72f2f169b154 could not be found. Apr 11 15:44:56 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:44:56 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-4e96b25e-9ec3-4b97-9607-a7e6308a43b3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Returning 404 to user: Instance 4f51cc22-e687-40e2-899a-72f2f169b154 could not be found. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:44:56 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-4e96b25e-9ec3-4b97-9607-a7e6308a43b3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4f51cc22-e687-40e2-899a-72f2f169b154" status: 404 len: 111 microversion: 2.1 time: 0.034298 Apr 11 15:44:56 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 272/805] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:44:56 2023] DELETE /compute/v2.1/servers/4f51cc22-e687-40e2-899a-72f2f169b154 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:44:56 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:44:56 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=10 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:44:56 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-6090e25f-9ec8-4b90-9c77-b4dae04fc814 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:44:56 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-6090e25f-9ec8-4b90-9c77-b4dae04fc814 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:44:56 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-6090e25f-9ec8-4b90-9c77-b4dae04fc814 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:56 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-6090e25f-9ec8-4b90-9c77-b4dae04fc814 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:56 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-6090e25f-9ec8-4b90-9c77-b4dae04fc814 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:56 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-6090e25f-9ec8-4b90-9c77-b4dae04fc814 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:44:56 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-6090e25f-9ec8-4b90-9c77-b4dae04fc814 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:44:56 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-6090e25f-9ec8-4b90-9c77-b4dae04fc814 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:44:56 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-6090e25f-9ec8-4b90-9c77-b4dae04fc814 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] HTTP exception thrown: Instance 4f51cc22-e687-40e2-899a-72f2f169b154 could not be found. Apr 11 15:44:56 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-6090e25f-9ec8-4b90-9c77-b4dae04fc814 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Request method failure captured: Apr 11 15:44:56 user devstack@n-api.service[61166]: request: GET /compute/v2.1/servers/4f51cc22-e687-40e2-899a-72f2f169b154 HTTP/1.1 Apr 11 15:44:56 user devstack@n-api.service[61166]: Accept: application/json Apr 11 15:44:56 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 15:44:56 user devstack@n-api.service[61166]: Connection: close Apr 11 15:44:56 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 15:44:56 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 15:44:56 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 15:44:56 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 15:44:56 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 15:44:56 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNX_MfySgeWQGetehYkoHqYg1G1945hTNCEJ0iZ6MzpnT3yZAJa_LjZxGoo77mYeoWNM22txPKHxqCAJQHMF1JaEqPSco0vUdydRE47pwKZna0AOIEDnSU3nak09PN7xX11kpifNQbUB7HIx3dygnGm9WJh4EQWIeaVGEcb-QhV49Vog Apr 11 15:44:56 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 15:44:56 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 15:44:56 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 15:44:56 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 15:44:56 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 15:44:56 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 15:44:56 user devstack@n-api.service[61166]: X-Project-Id: 312851c65ba1434691eca0cd2a8cd6d2 Apr 11 15:44:56 user devstack@n-api.service[61166]: X-Project-Name: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:44:56 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 15:44:56 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 15:44:56 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:44:56 user devstack@n-api.service[61166]: X-Tenant: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:44:56 user devstack@n-api.service[61166]: X-Tenant-Id: 312851c65ba1434691eca0cd2a8cd6d2 Apr 11 15:44:56 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:44:56 user devstack@n-api.service[61166]: X-User: tempest-TestVolumeBootPattern-1933582504-project-member Apr 11 15:44:56 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 15:44:56 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 15:44:56 user devstack@n-api.service[61166]: X-User-Id: c2110b74f38642afa560e1c9790d3f81 Apr 11 15:44:56 user devstack@n-api.service[61166]: X-User-Name: tempest-TestVolumeBootPattern-1933582504-project-member Apr 11 15:44:56 user devstack@n-api.service[61166]: method: > Apr 11 15:44:56 user devstack@n-api.service[61166]: exception: Instance 4f51cc22-e687-40e2-899a-72f2f169b154 could not be found. Apr 11 15:44:56 user devstack@n-api.service[61166]: action_args: {'id': '4f51cc22-e687-40e2-899a-72f2f169b154'} Apr 11 15:44:56 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f51cc22-e687-40e2-899a-72f2f169b154 could not be found. Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f51cc22-e687-40e2-899a-72f2f169b154 could not be found. Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f51cc22-e687-40e2-899a-72f2f169b154 could not be found. Apr 11 15:44:56 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:44:56 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-6090e25f-9ec8-4b90-9c77-b4dae04fc814 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Returning 404 to user: Instance 4f51cc22-e687-40e2-899a-72f2f169b154 could not be found. {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:44:56 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-6090e25f-9ec8-4b90-9c77-b4dae04fc814 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f51cc22-e687-40e2-899a-72f2f169b154" status: 404 len: 111 microversion: 2.1 time: 0.030083 Apr 11 15:44:56 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 268/806] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:44:56 2023] GET /compute/v2.1/servers/4f51cc22-e687-40e2-899a-72f2f169b154 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:44:59 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1177972057", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "60e0670e-2a18-47f6-921a-c69a3f375392", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24"}]}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:45:00 user devstack@n-api.service[61165]: DEBUG nova.network.neutron [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] validate_networks() for [('8d262ba8-b9c3-44ed-8431-6c295eb9ea24', None, None, None, None, None)] {{(pid=61165) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:45:00 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Flavor limits 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:45:00 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Image limits 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:45:00 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Flavor pref 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:45:00 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Image pref 0:0:0 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:45:00 user devstack@n-api.service[61165]: DEBUG nova.virt.hardware [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:45:00 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:45:00 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:45:00 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:45:00 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:45:00 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:45:00 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:45:00 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Getting quotas for project 312851c65ba1434691eca0cd2a8cd6d2. Resources: {'instances', 'cores', 'ram'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:45:00 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Getting quotas for user c2110b74f38642afa560e1c9790d3f81 and project 312851c65ba1434691eca0cd2a8cd6d2. Resources: {'instances', 'cores', 'ram'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:45:01 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Going to run 1 instances... {{(pid=61165) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:45:01 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='60e0670e-2a18-47f6-921a-c69a3f375392',volume_size=None,volume_type=None)] {{(pid=61165) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:45:01 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.155834 Apr 11 15:45:01 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 267/807] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 15:44:59 2023] POST /compute/v2.1/servers => generated 378 bytes in 1157 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 15:45:01 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-62813776-24ea-4d66-94c7-0cc6d3c5ce9f tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:45:01 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-62813776-24ea-4d66-94c7-0cc6d3c5ce9f tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:45:01 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-62813776-24ea-4d66-94c7-0cc6d3c5ce9f tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2110b74f38642afa560e1c9790d3f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312851c65ba1434691eca0cd2a8cd6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:45:01 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-62813776-24ea-4d66-94c7-0cc6d3c5ce9f tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d" status: 200 len: 1066 microversion: 2.1 time: 0.060612 Apr 11 15:45:01 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 273/808] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:45:01 2023] GET /compute/v2.1/servers/07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d => generated 1066 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:45:03 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-d6bcb0cf-139e-458a-a0dc-37640aa94a49 req-daa2ff94-f41f-4e60-a989-8ccb491981dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d", "tag": "8eaf93f6-bd22-4804-8044-4cd18b84370a"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:45:03 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-d6bcb0cf-139e-458a-a0dc-37640aa94a49 req-daa2ff94-f41f-4e60-a989-8ccb491981dd service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:45:03 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-d6bcb0cf-139e-458a-a0dc-37640aa94a49 req-daa2ff94-f41f-4e60-a989-8ccb491981dd service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:45:03 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-d6bcb0cf-139e-458a-a0dc-37640aa94a49 req-daa2ff94-f41f-4e60-a989-8ccb491981dd service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:45:03 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-d6bcb0cf-139e-458a-a0dc-37640aa94a49 req-daa2ff94-f41f-4e60-a989-8ccb491981dd service nova] Creating event network-changed:8eaf93f6-bd22-4804-8044-4cd18b84370a for instance 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d on user Apr 11 15:45:03 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-d6bcb0cf-139e-458a-a0dc-37640aa94a49 req-daa2ff94-f41f-4e60-a989-8ccb491981dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040065 Apr 11 15:45:03 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 269/809] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:45:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:45:09 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-f32a10b1-330a-4f47-a7ed-6b6e1ab77768 req-e9a5746f-9aee-4063-86d7-dacb1865b304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d", "name": "network-vif-plugged", "status": "completed", "tag": "8eaf93f6-bd22-4804-8044-4cd18b84370a"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:45:09 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-f32a10b1-330a-4f47-a7ed-6b6e1ab77768 req-e9a5746f-9aee-4063-86d7-dacb1865b304 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:45:09 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-f32a10b1-330a-4f47-a7ed-6b6e1ab77768 req-e9a5746f-9aee-4063-86d7-dacb1865b304 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:45:09 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-f32a10b1-330a-4f47-a7ed-6b6e1ab77768 req-e9a5746f-9aee-4063-86d7-dacb1865b304 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:45:09 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-f32a10b1-330a-4f47-a7ed-6b6e1ab77768 req-e9a5746f-9aee-4063-86d7-dacb1865b304 service nova] Creating event network-vif-plugged:8eaf93f6-bd22-4804-8044-4cd18b84370a for instance 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d on user Apr 11 15:45:09 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-f32a10b1-330a-4f47-a7ed-6b6e1ab77768 req-e9a5746f-9aee-4063-86d7-dacb1865b304 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031533 Apr 11 15:45:09 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 268/810] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:45:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:45:10 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-ee4528e3-5a3b-411e-8a36-d31f85a9dca6 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:45:10 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-ee4528e3-5a3b-411e-8a36-d31f85a9dca6 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:45:10 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:45:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ee4528e3-5a3b-411e-8a36-d31f85a9dca6 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:45:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ee4528e3-5a3b-411e-8a36-d31f85a9dca6 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:45:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ee4528e3-5a3b-411e-8a36-d31f85a9dca6 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:45:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ee4528e3-5a3b-411e-8a36-d31f85a9dca6 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:45:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ee4528e3-5a3b-411e-8a36-d31f85a9dca6 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:45:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ee4528e3-5a3b-411e-8a36-d31f85a9dca6 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:45:10 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-ee4528e3-5a3b-411e-8a36-d31f85a9dca6 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8492f96e5d4f54aaae3679c82b6759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd700a53aa25849e0afd562b05881d09a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:45:10 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-ee4528e3-5a3b-411e-8a36-d31f85a9dca6 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" status: 200 len: 1554 microversion: 2.1 time: 0.159746 Apr 11 15:45:10 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 274/811] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:45:10 2023] GET /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:45:11 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-7b146b7b-d555-4d94-833b-1a133e8c9da4 req-b6fff1c7-a5e8-4be8-b692-19d139e04ac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d", "name": "network-vif-plugged", "status": "completed", "tag": "8eaf93f6-bd22-4804-8044-4cd18b84370a"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:45:11 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-7b146b7b-d555-4d94-833b-1a133e8c9da4 req-b6fff1c7-a5e8-4be8-b692-19d139e04ac6 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:45:11 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-7b146b7b-d555-4d94-833b-1a133e8c9da4 req-b6fff1c7-a5e8-4be8-b692-19d139e04ac6 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:45:11 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-7b146b7b-d555-4d94-833b-1a133e8c9da4 req-b6fff1c7-a5e8-4be8-b692-19d139e04ac6 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:45:11 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-7b146b7b-d555-4d94-833b-1a133e8c9da4 req-b6fff1c7-a5e8-4be8-b692-19d139e04ac6 service nova] Creating event network-vif-plugged:8eaf93f6-bd22-4804-8044-4cd18b84370a for instance 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d on user Apr 11 15:45:11 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-7b146b7b-d555-4d94-833b-1a133e8c9da4 req-b6fff1c7-a5e8-4be8-b692-19d139e04ac6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027966 Apr 11 15:45:11 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 270/812] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:45:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:45:19 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:45:19 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:45:19 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:45:19 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:45:19 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-d564b749-03c5-480d-91de-02ad4325095b tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1849978819"}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:45:19 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-d564b749-03c5-480d-91de-02ad4325095b tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:45:19 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d564b749-03c5-480d-91de-02ad4325095b tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:45:19 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d564b749-03c5-480d-91de-02ad4325095b tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:45:19 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d564b749-03c5-480d-91de-02ad4325095b tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:45:19 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d564b749-03c5-480d-91de-02ad4325095b tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:45:19 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d564b749-03c5-480d-91de-02ad4325095b tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:45:19 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-d564b749-03c5-480d-91de-02ad4325095b tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:45:19 user devstack@n-api.service[61165]: INFO nova.network.security_group_api [None req-d564b749-03c5-480d-91de-02ad4325095b tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Removing security group 5e617e5e-c7fc-43ab-a247-c3834317c7d5 from port 7f4d2694-64e4-4dd0-af87-84d67de89287 Apr 11 15:45:20 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-d564b749-03c5-480d-91de-02ad4325095b tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/action" status: 202 len: 0 microversion: 2.1 time: 0.562429 Apr 11 15:45:20 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 269/813] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 15:45:19 2023] POST /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/action => generated 0 bytes in 564 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:45:20 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-05d5b462-2043-4c4d-bede-42143195a7b0 req-577f8045-02d7-4f71-aee1-ea5d3d2182a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e816ce5-4da8-4366-9fa1-c33a45ba87fd", "tag": "7f4d2694-64e4-4dd0-af87-84d67de89287"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:45:20 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:45:20 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-05d5b462-2043-4c4d-bede-42143195a7b0 req-577f8045-02d7-4f71-aee1-ea5d3d2182a4 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:45:20 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-05d5b462-2043-4c4d-bede-42143195a7b0 req-577f8045-02d7-4f71-aee1-ea5d3d2182a4 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:45:20 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-05d5b462-2043-4c4d-bede-42143195a7b0 req-577f8045-02d7-4f71-aee1-ea5d3d2182a4 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:45:20 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-05d5b462-2043-4c4d-bede-42143195a7b0 req-577f8045-02d7-4f71-aee1-ea5d3d2182a4 service nova] Creating event network-changed:7f4d2694-64e4-4dd0-af87-84d67de89287 for instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd on user Apr 11 15:45:20 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-05d5b462-2043-4c4d-bede-42143195a7b0 req-577f8045-02d7-4f71-aee1-ea5d3d2182a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034409 Apr 11 15:45:20 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 275/814] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:45:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:45:21 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:45:21 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:45:21 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-9daab920-1a57-40e2-875d-ea668dce96c6 req-3cb63d98-794a-45a7-9368-2069ebb394ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e816ce5-4da8-4366-9fa1-c33a45ba87fd", "tag": "7f4d2694-64e4-4dd0-af87-84d67de89287"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:45:21 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:45:21 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:45:21 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:45:21 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:45:21 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:45:21 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:45:21 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-9daab920-1a57-40e2-875d-ea668dce96c6 req-3cb63d98-794a-45a7-9368-2069ebb394ab service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:45:21 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-9daab920-1a57-40e2-875d-ea668dce96c6 req-3cb63d98-794a-45a7-9368-2069ebb394ab service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:45:21 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-9daab920-1a57-40e2-875d-ea668dce96c6 req-3cb63d98-794a-45a7-9368-2069ebb394ab service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:45:21 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-9daab920-1a57-40e2-875d-ea668dce96c6 req-3cb63d98-794a-45a7-9368-2069ebb394ab service nova] Creating event network-changed:7f4d2694-64e4-4dd0-af87-84d67de89287 for instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd on user Apr 11 15:45:21 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-9daab920-1a57-40e2-875d-ea668dce96c6 req-3cb63d98-794a-45a7-9368-2069ebb394ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032757 Apr 11 15:45:21 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 270/815] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:45:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:45:21 user devstack@n-api.service[61166]: DEBUG nova.objects.instance [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lazy-loading 'services' on Instance uuid 8e816ce5-4da8-4366-9fa1-c33a45ba87fd {{(pid=61166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 15:45:21 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/os-volume_attachments/65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79" status: 202 len: 0 microversion: 2.1 time: 0.191078 Apr 11 15:45:21 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 271/816] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 15:45:21 2023] DELETE /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/os-volume_attachments/65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:45:21 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-aefeb4bd-d4f1-4234-9c85-a1fc9f3dcd51 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:45:21 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-aefeb4bd-d4f1-4234-9c85-a1fc9f3dcd51 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:45:21 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-aefeb4bd-d4f1-4234-9c85-a1fc9f3dcd51 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:45:21 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-aefeb4bd-d4f1-4234-9c85-a1fc9f3dcd51 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:45:21 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-aefeb4bd-d4f1-4234-9c85-a1fc9f3dcd51 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:45:21 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-aefeb4bd-d4f1-4234-9c85-a1fc9f3dcd51 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:45:21 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-aefeb4bd-d4f1-4234-9c85-a1fc9f3dcd51 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:45:21 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-aefeb4bd-d4f1-4234-9c85-a1fc9f3dcd51 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:45:21 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-aefeb4bd-d4f1-4234-9c85-a1fc9f3dcd51 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061440 Apr 11 15:45:21 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 276/817] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:45:21 2023] GET /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:45:33 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:45:33 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:45:33 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-87d903de-64f2-41b7-98f3-bc30ba2a5b81 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:45:33 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-87d903de-64f2-41b7-98f3-bc30ba2a5b81 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:45:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-87d903de-64f2-41b7-98f3-bc30ba2a5b81 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:45:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-87d903de-64f2-41b7-98f3-bc30ba2a5b81 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:45:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-87d903de-64f2-41b7-98f3-bc30ba2a5b81 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:45:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-87d903de-64f2-41b7-98f3-bc30ba2a5b81 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:45:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-87d903de-64f2-41b7-98f3-bc30ba2a5b81 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:45:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-87d903de-64f2-41b7-98f3-bc30ba2a5b81 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:45:33 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-87d903de-64f2-41b7-98f3-bc30ba2a5b81 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] HTTP exception thrown: Instance dcbfcbfd-7e96-4271-94ee-60ef937e3b7e could not be found. Apr 11 15:45:33 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-87d903de-64f2-41b7-98f3-bc30ba2a5b81 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Request method failure captured: Apr 11 15:45:33 user devstack@n-api.service[61165]: request: GET /compute/v2.1/servers/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e HTTP/1.1 Apr 11 15:45:33 user devstack@n-api.service[61165]: Accept: application/json Apr 11 15:45:33 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 15:45:33 user devstack@n-api.service[61165]: Connection: close Apr 11 15:45:33 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 15:45:33 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 15:45:33 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 15:45:33 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 15:45:33 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 15:45:33 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNXrYvI576bfomvCXZOrRtX3e2WmI0QGGCZ-UwRPLPuWgxsvMU36nQ66FN0clBQeDihHABwOLAnAowbsIYeSiNwDxFudaK_nP7q4dDBOqIbmzwyfS5wL-Xwj8ivjkgXoPykYGSjyYhQcHlwVjZYOpOkrwJAeWupSEmtcb6WkxeGjFduc Apr 11 15:45:33 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 15:45:33 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 15:45:33 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 15:45:33 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 15:45:33 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 15:45:33 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 15:45:33 user devstack@n-api.service[61165]: X-Project-Id: bb7660e8f76b471487136806ee9eec62 Apr 11 15:45:33 user devstack@n-api.service[61165]: X-Project-Name: tempest-ServerActionsTestJSON-1659503440 Apr 11 15:45:33 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 15:45:33 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 15:45:33 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb7660e8f76b471487136806ee9eec62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bb7660e8f76b471487136806ee9eec62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb7660e8f76b471487136806ee9eec62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:45:33 user devstack@n-api.service[61165]: X-Tenant: tempest-ServerActionsTestJSON-1659503440 Apr 11 15:45:33 user devstack@n-api.service[61165]: X-Tenant-Id: bb7660e8f76b471487136806ee9eec62 Apr 11 15:45:33 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-ServerActionsTestJSON-1659503440 Apr 11 15:45:33 user devstack@n-api.service[61165]: X-User: tempest-ServerActionsTestJSON-1659503440-project-member Apr 11 15:45:33 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 15:45:33 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 15:45:33 user devstack@n-api.service[61165]: X-User-Id: 10720df0ac4f4e62a0a5c9883d600add Apr 11 15:45:33 user devstack@n-api.service[61165]: X-User-Name: tempest-ServerActionsTestJSON-1659503440-project-member Apr 11 15:45:33 user devstack@n-api.service[61165]: method: > Apr 11 15:45:33 user devstack@n-api.service[61165]: exception: Instance dcbfcbfd-7e96-4271-94ee-60ef937e3b7e could not be found. Apr 11 15:45:33 user devstack@n-api.service[61165]: action_args: {'id': 'dcbfcbfd-7e96-4271-94ee-60ef937e3b7e'} Apr 11 15:45:33 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcbfcbfd-7e96-4271-94ee-60ef937e3b7e could not be found. Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcbfcbfd-7e96-4271-94ee-60ef937e3b7e could not be found. Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcbfcbfd-7e96-4271-94ee-60ef937e3b7e could not be found. Apr 11 15:45:33 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:45:33 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-87d903de-64f2-41b7-98f3-bc30ba2a5b81 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Returning 404 to user: Instance dcbfcbfd-7e96-4271-94ee-60ef937e3b7e could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:45:33 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-87d903de-64f2-41b7-98f3-bc30ba2a5b81 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e" status: 404 len: 111 microversion: 2.1 time: 0.035500 Apr 11 15:45:33 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 271/818] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:45:33 2023] GET /compute/v2.1/servers/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:45:35 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=8 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:45:35 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:45:35 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-df675c76-cf09-4945-b1a4-8331901fdd62 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:45:35 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-df675c76-cf09-4945-b1a4-8331901fdd62 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:45:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-df675c76-cf09-4945-b1a4-8331901fdd62 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:45:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-df675c76-cf09-4945-b1a4-8331901fdd62 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:45:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-df675c76-cf09-4945-b1a4-8331901fdd62 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:45:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-df675c76-cf09-4945-b1a4-8331901fdd62 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:45:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-df675c76-cf09-4945-b1a4-8331901fdd62 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:45:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-df675c76-cf09-4945-b1a4-8331901fdd62 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:45:35 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-df675c76-cf09-4945-b1a4-8331901fdd62 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] HTTP exception thrown: Instance 6a805345-374c-4326-9e8f-39bfc7947a35 could not be found. Apr 11 15:45:35 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-df675c76-cf09-4945-b1a4-8331901fdd62 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Request method failure captured: Apr 11 15:45:35 user devstack@n-api.service[61166]: request: DELETE /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35 HTTP/1.1 Apr 11 15:45:35 user devstack@n-api.service[61166]: Accept: application/json Apr 11 15:45:35 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 15:45:35 user devstack@n-api.service[61166]: Connection: close Apr 11 15:45:35 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 15:45:35 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 15:45:35 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 15:45:35 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 15:45:35 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 15:45:35 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNXrYvI576bfomvCXZOrRtX3e2WmI0QGGCZ-UwRPLPuWgxsvMU36nQ66FN0clBQeDihHABwOLAnAowbsIYeSiNwDxFudaK_nP7q4dDBOqIbmzwyfS5wL-Xwj8ivjkgXoPykYGSjyYhQcHlwVjZYOpOkrwJAeWupSEmtcb6WkxeGjFduc Apr 11 15:45:35 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 15:45:35 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 15:45:35 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 15:45:35 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 15:45:35 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 15:45:35 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 15:45:35 user devstack@n-api.service[61166]: X-Project-Id: bb7660e8f76b471487136806ee9eec62 Apr 11 15:45:35 user devstack@n-api.service[61166]: X-Project-Name: tempest-ServerActionsTestJSON-1659503440 Apr 11 15:45:35 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 15:45:35 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 15:45:35 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb7660e8f76b471487136806ee9eec62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bb7660e8f76b471487136806ee9eec62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb7660e8f76b471487136806ee9eec62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:45:35 user devstack@n-api.service[61166]: X-Tenant: tempest-ServerActionsTestJSON-1659503440 Apr 11 15:45:35 user devstack@n-api.service[61166]: X-Tenant-Id: bb7660e8f76b471487136806ee9eec62 Apr 11 15:45:35 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-ServerActionsTestJSON-1659503440 Apr 11 15:45:35 user devstack@n-api.service[61166]: X-User: tempest-ServerActionsTestJSON-1659503440-project-member Apr 11 15:45:35 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 15:45:35 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 15:45:35 user devstack@n-api.service[61166]: X-User-Id: 10720df0ac4f4e62a0a5c9883d600add Apr 11 15:45:35 user devstack@n-api.service[61166]: X-User-Name: tempest-ServerActionsTestJSON-1659503440-project-member Apr 11 15:45:35 user devstack@n-api.service[61166]: method: > Apr 11 15:45:35 user devstack@n-api.service[61166]: exception: Instance 6a805345-374c-4326-9e8f-39bfc7947a35 could not be found. Apr 11 15:45:35 user devstack@n-api.service[61166]: action_args: {'id': '6a805345-374c-4326-9e8f-39bfc7947a35'} Apr 11 15:45:35 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a805345-374c-4326-9e8f-39bfc7947a35 could not be found. Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a805345-374c-4326-9e8f-39bfc7947a35 could not be found. Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a805345-374c-4326-9e8f-39bfc7947a35 could not be found. Apr 11 15:45:35 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:45:35 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-df675c76-cf09-4945-b1a4-8331901fdd62 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Returning 404 to user: Instance 6a805345-374c-4326-9e8f-39bfc7947a35 could not be found. {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:45:35 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-df675c76-cf09-4945-b1a4-8331901fdd62 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35" status: 404 len: 111 microversion: 2.1 time: 0.036058 Apr 11 15:45:35 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 272/819] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:45:35 2023] DELETE /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:45:35 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-51c893f9-4b70-43bb-b5ec-6d119da8e991 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:45:35 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-51c893f9-4b70-43bb-b5ec-6d119da8e991 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:45:35 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=12 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:45:35 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=14 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:45:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-51c893f9-4b70-43bb-b5ec-6d119da8e991 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:45:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-51c893f9-4b70-43bb-b5ec-6d119da8e991 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:45:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-51c893f9-4b70-43bb-b5ec-6d119da8e991 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:45:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-51c893f9-4b70-43bb-b5ec-6d119da8e991 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:45:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-51c893f9-4b70-43bb-b5ec-6d119da8e991 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:45:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-51c893f9-4b70-43bb-b5ec-6d119da8e991 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:45:35 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-51c893f9-4b70-43bb-b5ec-6d119da8e991 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] HTTP exception thrown: Instance 6a805345-374c-4326-9e8f-39bfc7947a35 could not be found. Apr 11 15:45:35 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-51c893f9-4b70-43bb-b5ec-6d119da8e991 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Request method failure captured: Apr 11 15:45:35 user devstack@n-api.service[61167]: request: GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35 HTTP/1.1 Apr 11 15:45:35 user devstack@n-api.service[61167]: Accept: application/json Apr 11 15:45:35 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 15:45:35 user devstack@n-api.service[61167]: Connection: close Apr 11 15:45:35 user devstack@n-api.service[61167]: Content-Length: 0 Apr 11 15:45:35 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 15:45:35 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 15:45:35 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 15:45:35 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 15:45:35 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNXrYvI576bfomvCXZOrRtX3e2WmI0QGGCZ-UwRPLPuWgxsvMU36nQ66FN0clBQeDihHABwOLAnAowbsIYeSiNwDxFudaK_nP7q4dDBOqIbmzwyfS5wL-Xwj8ivjkgXoPykYGSjyYhQcHlwVjZYOpOkrwJAeWupSEmtcb6WkxeGjFduc Apr 11 15:45:35 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 15:45:35 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 15:45:35 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 15:45:35 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 15:45:35 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 15:45:35 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 15:45:35 user devstack@n-api.service[61167]: X-Project-Id: bb7660e8f76b471487136806ee9eec62 Apr 11 15:45:35 user devstack@n-api.service[61167]: X-Project-Name: tempest-ServerActionsTestJSON-1659503440 Apr 11 15:45:35 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 15:45:35 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 15:45:35 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb7660e8f76b471487136806ee9eec62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bb7660e8f76b471487136806ee9eec62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb7660e8f76b471487136806ee9eec62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:45:35 user devstack@n-api.service[61167]: X-Tenant: tempest-ServerActionsTestJSON-1659503440 Apr 11 15:45:35 user devstack@n-api.service[61167]: X-Tenant-Id: bb7660e8f76b471487136806ee9eec62 Apr 11 15:45:35 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-ServerActionsTestJSON-1659503440 Apr 11 15:45:35 user devstack@n-api.service[61167]: X-User: tempest-ServerActionsTestJSON-1659503440-project-member Apr 11 15:45:35 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 15:45:35 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 15:45:35 user devstack@n-api.service[61167]: X-User-Id: 10720df0ac4f4e62a0a5c9883d600add Apr 11 15:45:35 user devstack@n-api.service[61167]: X-User-Name: tempest-ServerActionsTestJSON-1659503440-project-member Apr 11 15:45:35 user devstack@n-api.service[61167]: method: > Apr 11 15:45:35 user devstack@n-api.service[61167]: exception: Instance 6a805345-374c-4326-9e8f-39bfc7947a35 could not be found. Apr 11 15:45:35 user devstack@n-api.service[61167]: action_args: {'id': '6a805345-374c-4326-9e8f-39bfc7947a35'} Apr 11 15:45:35 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a805345-374c-4326-9e8f-39bfc7947a35 could not be found. Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a805345-374c-4326-9e8f-39bfc7947a35 could not be found. Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a805345-374c-4326-9e8f-39bfc7947a35 could not be found. Apr 11 15:45:35 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:45:35 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-51c893f9-4b70-43bb-b5ec-6d119da8e991 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Returning 404 to user: Instance 6a805345-374c-4326-9e8f-39bfc7947a35 could not be found. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:45:35 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-51c893f9-4b70-43bb-b5ec-6d119da8e991 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35" status: 404 len: 111 microversion: 2.1 time: 0.032829 Apr 11 15:45:35 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 277/820] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:45:35 2023] GET /compute/v2.1/servers/6a805345-374c-4326-9e8f-39bfc7947a35 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:45:35 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-5a7f7a19-6cd0-49cf-a5d2-bc53c40f4cef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Calling method '.version_select at 0x7f4c2f0956c0>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:45:35 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-5a7f7a19-6cd0-49cf-a5d2-bc53c40f4cef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1137963694" status: 202 len: 0 microversion: 2.1 time: 0.025707 Apr 11 15:45:35 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 272/821] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 15:45:35 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1137963694 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:45:47 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:45:47 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:45:47 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-825f08b9-a3b8-4d48-a3e1-eb13ad928349 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Action: 'create', calling method: .version_select at 0x7f4c2ed381f0>, body: {"keypair": {"name": "tempest-keypair-363003976", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESSrnhmezC7HQi+h0OdTtButyUJkAu5n8hHJP9eUrxeUgZ1v8+l+B++ncR6In95oR0ORBJlzSH/RoWq4EEt/BxSJF7IPv0bb8yRJgYBk+JaLJ0rhNGgPTIehYPdLc82UA=="}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:45:47 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-825f08b9-a3b8-4d48-a3e1-eb13ad928349 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Getting quotas for project 85c9dbdbc7b641f096dc292ea7bf7cd4. Resources: {'key_pairs'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:45:47 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-825f08b9-a3b8-4d48-a3e1-eb13ad928349 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Getting quotas for user 0b244004380d43699c5a06e817224b3e and project 85c9dbdbc7b641f096dc292ea7bf7cd4. Resources: {'key_pairs'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:45:47 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-825f08b9-a3b8-4d48-a3e1-eb13ad928349 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.150729 Apr 11 15:45:47 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 273/822] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 15:45:47 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:45:48 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-264655155", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "networks": [{"uuid": "81031696-fd25-42a1-8c36-43a6eacbab12"}], "security_groups": [{"name": "tempest-securitygroup--1822259904"}], "key_name": "tempest-keypair-363003976", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:45:48 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:45:48 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:45:48 user devstack@n-api.service[61167]: DEBUG nova.network.neutron [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] validate_networks() for [('81031696-fd25-42a1-8c36-43a6eacbab12', None, None, None, None, None)] {{(pid=61167) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:45:49 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Flavor limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:45:49 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Image limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:45:49 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Flavor pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:45:49 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Image pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:45:49 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:45:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:45:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:45:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:45:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:45:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:45:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:45:49 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Getting quotas for project 85c9dbdbc7b641f096dc292ea7bf7cd4. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:45:49 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Getting quotas for user 0b244004380d43699c5a06e817224b3e and project 85c9dbdbc7b641f096dc292ea7bf7cd4. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:45:49 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Going to run 1 instances... {{(pid=61167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:45:49 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52fe638c-5ada-47d5-b376-233bfa808a37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:45:49 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.591726 Apr 11 15:45:49 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 278/823] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 15:45:48 2023] POST /compute/v2.1/servers => generated 404 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 15:45:49 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:45:49 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:45:49 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-1508b62c-5dea-4f90-8770-7dd8bf66a7ee tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:45:49 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-1508b62c-5dea-4f90-8770-7dd8bf66a7ee tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:45:49 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-1508b62c-5dea-4f90-8770-7dd8bf66a7ee tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b244004380d43699c5a06e817224b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c9dbdbc7b641f096dc292ea7bf7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:45:49 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-1508b62c-5dea-4f90-8770-7dd8bf66a7ee tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88" status: 200 len: 1238 microversion: 2.1 time: 0.073604 Apr 11 15:45:49 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 273/824] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:45:49 2023] GET /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88 => generated 1238 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:45:51 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-9daacb37-2e2e-4935-8a86-a55e540e2c4d tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:45:51 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-9daacb37-2e2e-4935-8a86-a55e540e2c4d tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:45:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-9daacb37-2e2e-4935-8a86-a55e540e2c4d tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:45:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-9daacb37-2e2e-4935-8a86-a55e540e2c4d tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:45:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-9daacb37-2e2e-4935-8a86-a55e540e2c4d tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:45:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-9daacb37-2e2e-4935-8a86-a55e540e2c4d tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:45:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-9daacb37-2e2e-4935-8a86-a55e540e2c4d tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:45:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-9daacb37-2e2e-4935-8a86-a55e540e2c4d tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:45:51 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-9daacb37-2e2e-4935-8a86-a55e540e2c4d tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2110b74f38642afa560e1c9790d3f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312851c65ba1434691eca0cd2a8cd6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:45:51 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-9daacb37-2e2e-4935-8a86-a55e540e2c4d tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d" status: 200 len: 1394 microversion: 2.1 time: 0.138643 Apr 11 15:45:51 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 274/825] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:45:51 2023] GET /compute/v2.1/servers/07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d => generated 1394 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:45:51 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-b6a46873-a90c-4e57-ab69-957053e35591 req-873b0cf4-99fd-40f7-92ad-0f27b41ee1a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0fc18ff-897c-4f97-95b6-9f25d11dba88", "tag": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:45:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-b6a46873-a90c-4e57-ab69-957053e35591 req-873b0cf4-99fd-40f7-92ad-0f27b41ee1a2 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:45:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-b6a46873-a90c-4e57-ab69-957053e35591 req-873b0cf4-99fd-40f7-92ad-0f27b41ee1a2 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:45:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-b6a46873-a90c-4e57-ab69-957053e35591 req-873b0cf4-99fd-40f7-92ad-0f27b41ee1a2 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:45:51 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-b6a46873-a90c-4e57-ab69-957053e35591 req-873b0cf4-99fd-40f7-92ad-0f27b41ee1a2 service nova] Creating event network-changed:cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 for instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 on user Apr 11 15:45:51 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-b6a46873-a90c-4e57-ab69-957053e35591 req-873b0cf4-99fd-40f7-92ad-0f27b41ee1a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029309 Apr 11 15:45:51 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 279/826] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:45:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:45:54 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-2f9bf738-15a2-4305-9378-c9147de151c5 req-72bfe26a-1f8a-4df9-81ed-078f9fa330a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0fc18ff-897c-4f97-95b6-9f25d11dba88", "name": "network-vif-plugged", "status": "completed", "tag": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:45:54 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-2f9bf738-15a2-4305-9378-c9147de151c5 req-72bfe26a-1f8a-4df9-81ed-078f9fa330a8 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:45:54 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-2f9bf738-15a2-4305-9378-c9147de151c5 req-72bfe26a-1f8a-4df9-81ed-078f9fa330a8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:45:54 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-2f9bf738-15a2-4305-9378-c9147de151c5 req-72bfe26a-1f8a-4df9-81ed-078f9fa330a8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:45:54 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-2f9bf738-15a2-4305-9378-c9147de151c5 req-72bfe26a-1f8a-4df9-81ed-078f9fa330a8 service nova] Creating event network-vif-plugged:cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 for instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 on user Apr 11 15:45:54 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-2f9bf738-15a2-4305-9378-c9147de151c5 req-72bfe26a-1f8a-4df9-81ed-078f9fa330a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039533 Apr 11 15:45:54 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 274/827] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:45:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:45:56 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-f97c3db1-a316-41e4-afb9-223f4adb5bff req-fa0fcd25-71b4-45ef-b408-16ecd221c7a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0fc18ff-897c-4f97-95b6-9f25d11dba88", "name": "network-vif-plugged", "status": "completed", "tag": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:45:56 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-f97c3db1-a316-41e4-afb9-223f4adb5bff req-fa0fcd25-71b4-45ef-b408-16ecd221c7a0 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:45:56 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-f97c3db1-a316-41e4-afb9-223f4adb5bff req-fa0fcd25-71b4-45ef-b408-16ecd221c7a0 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:45:56 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-f97c3db1-a316-41e4-afb9-223f4adb5bff req-fa0fcd25-71b4-45ef-b408-16ecd221c7a0 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:45:56 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-f97c3db1-a316-41e4-afb9-223f4adb5bff req-fa0fcd25-71b4-45ef-b408-16ecd221c7a0 service nova] Creating event network-vif-plugged:cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 for instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 on user Apr 11 15:45:56 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-f97c3db1-a316-41e4-afb9-223f4adb5bff req-fa0fcd25-71b4-45ef-b408-16ecd221c7a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031034 Apr 11 15:45:56 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 275/828] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:45:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:46:10 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:46:10 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:46:10 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:46:10 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=4 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:46:10 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-d72ad826-a382-4415-8899-62873d004842 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:46:10 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-d72ad826-a382-4415-8899-62873d004842 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:46:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d72ad826-a382-4415-8899-62873d004842 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:46:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d72ad826-a382-4415-8899-62873d004842 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:46:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d72ad826-a382-4415-8899-62873d004842 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:46:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d72ad826-a382-4415-8899-62873d004842 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:46:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d72ad826-a382-4415-8899-62873d004842 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:46:10 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d72ad826-a382-4415-8899-62873d004842 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:46:10 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-d72ad826-a382-4415-8899-62873d004842 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.130821 Apr 11 15:46:10 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 280/829] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 15:46:10 2023] GET /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/os-interface => generated 282 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:46:11 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:46:11 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:46:11 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:46:11 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-43baf712-8783-437c-8633-615f47286637 req-e173f183-f6df-4ced-a141-cfb38b9ca8b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a", "tag": "35ac8f6f-2998-4274-ab63-df7086194703"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:46:11 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-43baf712-8783-437c-8633-615f47286637 req-e173f183-f6df-4ced-a141-cfb38b9ca8b9 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:46:11 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-43baf712-8783-437c-8633-615f47286637 req-e173f183-f6df-4ced-a141-cfb38b9ca8b9 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:46:11 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-43baf712-8783-437c-8633-615f47286637 req-e173f183-f6df-4ced-a141-cfb38b9ca8b9 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:46:11 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-43baf712-8783-437c-8633-615f47286637 req-e173f183-f6df-4ced-a141-cfb38b9ca8b9 service nova] Creating event network-changed:35ac8f6f-2998-4274-ab63-df7086194703 for instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a on user Apr 11 15:46:11 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-43baf712-8783-437c-8633-615f47286637 req-e173f183-f6df-4ced-a141-cfb38b9ca8b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037055 Apr 11 15:46:11 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 275/830] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:46:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:46:11 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:46:11 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:46:11 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=8 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:46:11 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-b83cd4b5-fc21-4874-9b50-17e1af7c42d1 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:46:11 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3"}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:46:11 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-b83cd4b5-fc21-4874-9b50-17e1af7c42d1 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:46:11 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:46:11 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b83cd4b5-fc21-4874-9b50-17e1af7c42d1 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:46:11 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b83cd4b5-fc21-4874-9b50-17e1af7c42d1 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:46:11 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b83cd4b5-fc21-4874-9b50-17e1af7c42d1 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:46:11 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b83cd4b5-fc21-4874-9b50-17e1af7c42d1 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:46:11 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:46:11 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b83cd4b5-fc21-4874-9b50-17e1af7c42d1 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:46:11 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b83cd4b5-fc21-4874-9b50-17e1af7c42d1 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:46:11 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:46:11 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:46:11 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:46:11 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:46:11 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:46:11 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-b83cd4b5-fc21-4874-9b50-17e1af7c42d1 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042377 Apr 11 15:46:11 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 281/831] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:46:11 2023] GET /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 15:46:11 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-a4cdb5af-3e40-4b65-8793-5a0ed959bd42 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:46:11 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-a4cdb5af-3e40-4b65-8793-5a0ed959bd42 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:46:11 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-a4cdb5af-3e40-4b65-8793-5a0ed959bd42 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:46:11 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-a4cdb5af-3e40-4b65-8793-5a0ed959bd42 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:46:11 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-a4cdb5af-3e40-4b65-8793-5a0ed959bd42 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:46:11 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-a4cdb5af-3e40-4b65-8793-5a0ed959bd42 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:46:11 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-a4cdb5af-3e40-4b65-8793-5a0ed959bd42 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:46:11 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-a4cdb5af-3e40-4b65-8793-5a0ed959bd42 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:46:11 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-a4cdb5af-3e40-4b65-8793-5a0ed959bd42 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] HTTP exception thrown: Instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd is not attached to volume 65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 Apr 11 15:46:11 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-a4cdb5af-3e40-4b65-8793-5a0ed959bd42 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Request method failure captured: Apr 11 15:46:11 user devstack@n-api.service[61165]: request: DELETE /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/os-volume_attachments/65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 HTTP/1.1 Apr 11 15:46:11 user devstack@n-api.service[61165]: Accept: application/json Apr 11 15:46:11 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 15:46:11 user devstack@n-api.service[61165]: Connection: close Apr 11 15:46:11 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 15:46:11 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 15:46:11 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 15:46:11 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 15:46:11 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 15:46:11 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNX5BcTshUbhWFRlg8t_zz9-lO37xLS5_qPcHcMwZTMQwRt4-or551ovVhKCAIBaCeMNrORffTlZsBlQimdDmzpIuoYxvEBmKfToUDowo0nTS3d21BIn-SO-2Yx-r5ng4wKQzH6UThKxvWXMHzNTatOGJbb71hvxv9ohtGR1eUXPnvUI Apr 11 15:46:11 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 15:46:11 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 15:46:11 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 15:46:11 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 15:46:11 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 15:46:11 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 15:46:11 user devstack@n-api.service[61165]: X-Project-Id: c23461a3d7ca49f6a77d3fde6f1009d3 Apr 11 15:46:11 user devstack@n-api.service[61165]: X-Project-Name: tempest-TestMinimumBasicScenario-673773229 Apr 11 15:46:11 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 15:46:11 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 15:46:11 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c23461a3d7ca49f6a77d3fde6f1009d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c23461a3d7ca49f6a77d3fde6f1009d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c23461a3d7ca49f6a77d3fde6f1009d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:46:11 user devstack@n-api.service[61165]: X-Tenant: tempest-TestMinimumBasicScenario-673773229 Apr 11 15:46:11 user devstack@n-api.service[61165]: X-Tenant-Id: c23461a3d7ca49f6a77d3fde6f1009d3 Apr 11 15:46:11 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-TestMinimumBasicScenario-673773229 Apr 11 15:46:11 user devstack@n-api.service[61165]: X-User: tempest-TestMinimumBasicScenario-673773229-project-member Apr 11 15:46:11 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 15:46:11 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 15:46:11 user devstack@n-api.service[61165]: X-User-Id: 044f17aee3324b3a97bebe935548b3b4 Apr 11 15:46:11 user devstack@n-api.service[61165]: X-User-Name: tempest-TestMinimumBasicScenario-673773229-project-member Apr 11 15:46:11 user devstack@n-api.service[61165]: method: > Apr 11 15:46:11 user devstack@n-api.service[61165]: exception: Instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd is not attached to volume 65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 Apr 11 15:46:11 user devstack@n-api.service[61165]: action_args: {'server_id': '8e816ce5-4da8-4366-9fa1-c33a45ba87fd', 'id': '65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79'} Apr 11 15:46:11 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:46:11 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:46:11 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 11 15:46:11 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 11 15:46:11 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 11 15:46:11 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 11 15:46:11 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 11 15:46:11 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 11 15:46:11 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79. Apr 11 15:46:11 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:46:11 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:46:11 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:46:11 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:46:11 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:46:11 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:46:11 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:46:11 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:46:11 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:46:11 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:46:11 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 11 15:46:11 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 11 15:46:11 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd is not attached to volume 65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 Apr 11 15:46:11 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:46:11 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:46:11 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:46:11 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:46:11 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:46:11 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:46:11 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:46:11 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:46:11 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd is not attached to volume 65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 Apr 11 15:46:11 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:46:11 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-a4cdb5af-3e40-4b65-8793-5a0ed959bd42 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Returning 404 to user: Instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd is not attached to volume 65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:46:11 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-a4cdb5af-3e40-4b65-8793-5a0ed959bd42 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/os-volume_attachments/65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79" status: 404 len: 154 microversion: 2.1 time: 0.096365 Apr 11 15:46:11 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 276/832] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 15:46:11 2023] DELETE /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/os-volume_attachments/65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:46:11 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.359611 Apr 11 15:46:11 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 276/833] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 15:46:11 2023] POST /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/os-volume_attachments => generated 194 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:46:12 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:46:12 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:46:12 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:46:12 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:46:12 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:46:12 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:46:12 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:46:12 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:46:12 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Going to try to terminate instance {{(pid=61167) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:46:12 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd" status: 204 len: 0 microversion: 2.1 time: 0.128506 Apr 11 15:46:12 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 282/834] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:46:12 2023] DELETE /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:46:12 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-c475a085-6bff-4d82-a173-55d5a74fc839 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:46:12 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-c475a085-6bff-4d82-a173-55d5a74fc839 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:46:12 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c475a085-6bff-4d82-a173-55d5a74fc839 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:46:12 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c475a085-6bff-4d82-a173-55d5a74fc839 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:46:12 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c475a085-6bff-4d82-a173-55d5a74fc839 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:46:12 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c475a085-6bff-4d82-a173-55d5a74fc839 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:46:12 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c475a085-6bff-4d82-a173-55d5a74fc839 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:46:12 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c475a085-6bff-4d82-a173-55d5a74fc839 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:46:13 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-c475a085-6bff-4d82-a173-55d5a74fc839 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044f17aee3324b3a97bebe935548b3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23461a3d7ca49f6a77d3fde6f1009d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:46:13 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-c475a085-6bff-4d82-a173-55d5a74fc839 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd" status: 200 len: 1541 microversion: 2.1 time: 0.185714 Apr 11 15:46:13 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 277/835] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:46:12 2023] GET /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd => generated 1541 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:46:13 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-a2d33932-6007-43bf-8c8e-770e6ddf4b60 req-123218f1-183c-410f-a79b-10dca6c7c5c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e816ce5-4da8-4366-9fa1-c33a45ba87fd", "name": "network-vif-unplugged", "status": "completed", "tag": "7f4d2694-64e4-4dd0-af87-84d67de89287"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:46:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-a2d33932-6007-43bf-8c8e-770e6ddf4b60 req-123218f1-183c-410f-a79b-10dca6c7c5c4 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:46:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-a2d33932-6007-43bf-8c8e-770e6ddf4b60 req-123218f1-183c-410f-a79b-10dca6c7c5c4 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:46:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-a2d33932-6007-43bf-8c8e-770e6ddf4b60 req-123218f1-183c-410f-a79b-10dca6c7c5c4 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:46:13 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-a2d33932-6007-43bf-8c8e-770e6ddf4b60 req-123218f1-183c-410f-a79b-10dca6c7c5c4 service nova] Creating event network-vif-unplugged:7f4d2694-64e4-4dd0-af87-84d67de89287 for instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd on user Apr 11 15:46:13 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-a2d33932-6007-43bf-8c8e-770e6ddf4b60 req-123218f1-183c-410f-a79b-10dca6c7c5c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031659 Apr 11 15:46:13 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 277/836] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:46:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:46:14 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-dd9a0d32-8b1e-4639-ac53-6efe4596ccfd req-43914ae4-2cda-46ae-b2d6-23e61c369522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e816ce5-4da8-4366-9fa1-c33a45ba87fd", "name": "network-vif-deleted", "tag": "7f4d2694-64e4-4dd0-af87-84d67de89287"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:46:14 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-dd9a0d32-8b1e-4639-ac53-6efe4596ccfd req-43914ae4-2cda-46ae-b2d6-23e61c369522 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:46:14 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-dd9a0d32-8b1e-4639-ac53-6efe4596ccfd req-43914ae4-2cda-46ae-b2d6-23e61c369522 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:46:14 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-dd9a0d32-8b1e-4639-ac53-6efe4596ccfd req-43914ae4-2cda-46ae-b2d6-23e61c369522 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:46:14 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-dd9a0d32-8b1e-4639-ac53-6efe4596ccfd req-43914ae4-2cda-46ae-b2d6-23e61c369522 service nova] Creating event network-vif-deleted:7f4d2694-64e4-4dd0-af87-84d67de89287 for instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd on user Apr 11 15:46:14 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-dd9a0d32-8b1e-4639-ac53-6efe4596ccfd req-43914ae4-2cda-46ae-b2d6-23e61c369522 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031049 Apr 11 15:46:14 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 283/837] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:46:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:46:15 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-1002bdc2-35c2-4bf5-a563-6de27ced34f5 req-88360f50-2c34-4500-8a83-b3812a643e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e816ce5-4da8-4366-9fa1-c33a45ba87fd", "name": "network-vif-plugged", "status": "completed", "tag": "7f4d2694-64e4-4dd0-af87-84d67de89287"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:46:15 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-1002bdc2-35c2-4bf5-a563-6de27ced34f5 req-88360f50-2c34-4500-8a83-b3812a643e3e service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:46:15 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-1002bdc2-35c2-4bf5-a563-6de27ced34f5 req-88360f50-2c34-4500-8a83-b3812a643e3e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:46:15 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-1002bdc2-35c2-4bf5-a563-6de27ced34f5 req-88360f50-2c34-4500-8a83-b3812a643e3e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:46:15 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-1002bdc2-35c2-4bf5-a563-6de27ced34f5 req-88360f50-2c34-4500-8a83-b3812a643e3e service nova] Creating event network-vif-plugged:7f4d2694-64e4-4dd0-af87-84d67de89287 for instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd on user Apr 11 15:46:15 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-1002bdc2-35c2-4bf5-a563-6de27ced34f5 req-88360f50-2c34-4500-8a83-b3812a643e3e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029397 Apr 11 15:46:15 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 278/838] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:46:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:46:18 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:46:18 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:46:18 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:46:18 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:46:18 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:46:18 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:46:18 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:46:18 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:46:18 user devstack@n-api.service[61166]: DEBUG nova.objects.instance [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'flavor' on Instance uuid c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a {{(pid=61166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 15:46:18 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/action" status: 200 len: 32 microversion: 2.1 time: 0.160314 Apr 11 15:46:18 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 278/839] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 15:46:18 2023] POST /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/action => generated 32 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 15:46:18 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-d2ee70a9-b3a9-44b3-b3ec-7cccf60335ac tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:46:18 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-d2ee70a9-b3a9-44b3-b3ec-7cccf60335ac tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:46:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d2ee70a9-b3a9-44b3-b3ec-7cccf60335ac tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:46:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d2ee70a9-b3a9-44b3-b3ec-7cccf60335ac tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:46:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d2ee70a9-b3a9-44b3-b3ec-7cccf60335ac tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:46:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d2ee70a9-b3a9-44b3-b3ec-7cccf60335ac tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:46:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d2ee70a9-b3a9-44b3-b3ec-7cccf60335ac tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:46:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d2ee70a9-b3a9-44b3-b3ec-7cccf60335ac tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:46:18 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-d2ee70a9-b3a9-44b3-b3ec-7cccf60335ac tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8492f96e5d4f54aaae3679c82b6759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd700a53aa25849e0afd562b05881d09a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:46:18 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-d2ee70a9-b3a9-44b3-b3ec-7cccf60335ac tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" status: 200 len: 1724 microversion: 2.1 time: 0.152923 Apr 11 15:46:18 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 284/840] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:46:18 2023] GET /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:46:19 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-85285fb0-a6ab-4f76-b723-8ce16701f8a2 req-94fab5aa-82b3-414d-934b-4260b8e8ce06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a", "name": "network-vif-unplugged", "status": "completed", "tag": "35ac8f6f-2998-4274-ab63-df7086194703"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:46:19 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-85285fb0-a6ab-4f76-b723-8ce16701f8a2 req-94fab5aa-82b3-414d-934b-4260b8e8ce06 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:46:19 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-85285fb0-a6ab-4f76-b723-8ce16701f8a2 req-94fab5aa-82b3-414d-934b-4260b8e8ce06 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:46:19 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-85285fb0-a6ab-4f76-b723-8ce16701f8a2 req-94fab5aa-82b3-414d-934b-4260b8e8ce06 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:46:19 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-85285fb0-a6ab-4f76-b723-8ce16701f8a2 req-94fab5aa-82b3-414d-934b-4260b8e8ce06 service nova] Creating event network-vif-unplugged:35ac8f6f-2998-4274-ab63-df7086194703 for instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a on user Apr 11 15:46:19 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-85285fb0-a6ab-4f76-b723-8ce16701f8a2 req-94fab5aa-82b3-414d-934b-4260b8e8ce06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031715 Apr 11 15:46:19 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 279/841] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:46:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:46:21 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-619e7683-6ca8-4703-b642-7d3c5dc5032a req-ff70caa9-f40c-4503-998c-0d7e5c5b4cef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a", "name": "network-vif-plugged", "status": "completed", "tag": "35ac8f6f-2998-4274-ab63-df7086194703"}, {"server_uuid": "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a", "name": "network-vif-plugged", "status": "completed", "tag": "35ac8f6f-2998-4274-ab63-df7086194703"}, {"server_uuid": "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a", "name": "network-vif-plugged", "status": "completed", "tag": "35ac8f6f-2998-4274-ab63-df7086194703"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:46:21 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-619e7683-6ca8-4703-b642-7d3c5dc5032a req-ff70caa9-f40c-4503-998c-0d7e5c5b4cef service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:46:21 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-619e7683-6ca8-4703-b642-7d3c5dc5032a req-ff70caa9-f40c-4503-998c-0d7e5c5b4cef service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:46:21 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-619e7683-6ca8-4703-b642-7d3c5dc5032a req-ff70caa9-f40c-4503-998c-0d7e5c5b4cef service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:46:21 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-619e7683-6ca8-4703-b642-7d3c5dc5032a req-ff70caa9-f40c-4503-998c-0d7e5c5b4cef service nova] Creating event network-vif-plugged:35ac8f6f-2998-4274-ab63-df7086194703 for instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a on user Apr 11 15:46:21 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-619e7683-6ca8-4703-b642-7d3c5dc5032a req-ff70caa9-f40c-4503-998c-0d7e5c5b4cef service nova] Creating event network-vif-plugged:35ac8f6f-2998-4274-ab63-df7086194703 for instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a on user Apr 11 15:46:21 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-619e7683-6ca8-4703-b642-7d3c5dc5032a req-ff70caa9-f40c-4503-998c-0d7e5c5b4cef service nova] Creating event network-vif-plugged:35ac8f6f-2998-4274-ab63-df7086194703 for instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a on user Apr 11 15:46:21 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-619e7683-6ca8-4703-b642-7d3c5dc5032a req-ff70caa9-f40c-4503-998c-0d7e5c5b4cef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.063997 Apr 11 15:46:21 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 279/842] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:46:21 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:46:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-c4753215-9f9c-499c-85c1-f65141255df8 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:46:39 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-c4753215-9f9c-499c-85c1-f65141255df8 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:46:39 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:46:39 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:46:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c4753215-9f9c-499c-85c1-f65141255df8 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:46:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c4753215-9f9c-499c-85c1-f65141255df8 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:46:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c4753215-9f9c-499c-85c1-f65141255df8 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:46:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c4753215-9f9c-499c-85c1-f65141255df8 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:46:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c4753215-9f9c-499c-85c1-f65141255df8 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:46:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c4753215-9f9c-499c-85c1-f65141255df8 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:46:39 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-c4753215-9f9c-499c-85c1-f65141255df8 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b244004380d43699c5a06e817224b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c9dbdbc7b641f096dc292ea7bf7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:46:39 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-c4753215-9f9c-499c-85c1-f65141255df8 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88" status: 200 len: 1553 microversion: 2.1 time: 0.243467 Apr 11 15:46:39 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 285/843] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:46:39 2023] GET /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88 => generated 1553 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:46:51 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=10 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:46:51 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=18 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:46:51 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-6e645bb6-ac61-4320-bd79-93062a36482f tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:46:51 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-6e645bb6-ac61-4320-bd79-93062a36482f tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:46:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-6e645bb6-ac61-4320-bd79-93062a36482f tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:46:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-6e645bb6-ac61-4320-bd79-93062a36482f tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:46:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-6e645bb6-ac61-4320-bd79-93062a36482f tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:46:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-6e645bb6-ac61-4320-bd79-93062a36482f tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:46:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-6e645bb6-ac61-4320-bd79-93062a36482f tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:46:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-6e645bb6-ac61-4320-bd79-93062a36482f tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:46:51 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-6e645bb6-ac61-4320-bd79-93062a36482f tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2110b74f38642afa560e1c9790d3f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312851c65ba1434691eca0cd2a8cd6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:46:51 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-6e645bb6-ac61-4320-bd79-93062a36482f tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d" status: 200 len: 1394 microversion: 2.1 time: 0.158634 Apr 11 15:46:51 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 280/844] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:46:51 2023] GET /compute/v2.1/servers/07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d => generated 1394 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:46:51 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=8 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:46:51 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:46:51 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-b6c77744-4b28-425c-b22a-e2a900f1cca8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-501785179"}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:46:51 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-b6c77744-4b28-425c-b22a-e2a900f1cca8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:46:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b6c77744-4b28-425c-b22a-e2a900f1cca8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:46:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b6c77744-4b28-425c-b22a-e2a900f1cca8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:46:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b6c77744-4b28-425c-b22a-e2a900f1cca8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:46:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b6c77744-4b28-425c-b22a-e2a900f1cca8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:46:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b6c77744-4b28-425c-b22a-e2a900f1cca8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:46:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b6c77744-4b28-425c-b22a-e2a900f1cca8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:46:51 user devstack@n-api.service[61166]: INFO nova.compute.api [None req-b6c77744-4b28-425c-b22a-e2a900f1cca8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Attempting to quiesce instance before volume snapshot. Apr 11 15:46:51 user devstack@n-api.service[61166]: INFO nova.compute.api [None req-b6c77744-4b28-425c-b22a-e2a900f1cca8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 11 15:46:52 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-b6c77744-4b28-425c-b22a-e2a900f1cca8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Creating snapshot from volume 60e0670e-2a18-47f6-921a-c69a3f375392. {{(pid=61166) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 11 15:46:54 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-b6c77744-4b28-425c-b22a-e2a900f1cca8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "POST /compute/v2.1/servers/07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d/action" status: 202 len: 0 microversion: 2.1 time: 2.749314 Apr 11 15:46:54 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 280/845] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 15:46:51 2023] POST /compute/v2.1/servers/07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d/action => generated 0 bytes in 2751 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 11 15:46:54 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1777431458", "imageRef": "41f1d5e5-9dc1-414f-8cfe-8273284c0122", "flavorRef": "42", "networks": [{"uuid": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24"}]}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:46:54 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:46:54 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:46:54 user devstack@n-api.service[61167]: DEBUG nova.network.neutron [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] validate_networks() for [('8d262ba8-b9c3-44ed-8431-6c295eb9ea24', None, None, None, None, None)] {{(pid=61167) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:46:55 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Flavor limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:46:55 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Image limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:46:55 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Flavor pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:46:55 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Image pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:46:55 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:46:55 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:46:55 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:46:55 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:46:55 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:46:55 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:46:55 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:46:55 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Getting quotas for project 312851c65ba1434691eca0cd2a8cd6d2. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:46:55 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Getting quotas for user c2110b74f38642afa560e1c9790d3f81 and project 312851c65ba1434691eca0cd2a8cd6d2. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:46:55 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Going to run 1 instances... {{(pid=61167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:46:55 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='6df8d911-049c-42c0-8e12-edbc89102025',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:46:55 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.532197 Apr 11 15:46:55 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 286/846] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 15:46:54 2023] POST /compute/v2.1/servers => generated 378 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 15:46:55 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-c3e5ad16-9127-4d90-8cad-2a06dea6aaa4 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:46:55 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-c3e5ad16-9127-4d90-8cad-2a06dea6aaa4 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:46:55 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-c3e5ad16-9127-4d90-8cad-2a06dea6aaa4 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2110b74f38642afa560e1c9790d3f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312851c65ba1434691eca0cd2a8cd6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:46:55 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-c3e5ad16-9127-4d90-8cad-2a06dea6aaa4 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f4f0b39a-e99b-4bc7-aecc-24d4f754e674" status: 200 len: 1224 microversion: 2.1 time: 0.062343 Apr 11 15:46:55 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 281/847] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:46:55 2023] GET /compute/v2.1/servers/f4f0b39a-e99b-4bc7-aecc-24d4f754e674 => generated 1224 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:46:57 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-9a231c9e-07eb-443d-b50a-2a33feffdd2a req-90b2506f-13b6-478e-94b1-5ef7d3801523 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4f0b39a-e99b-4bc7-aecc-24d4f754e674", "tag": "53647a47-cc0c-42e6-a4c0-c12a1dab3deb"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:46:57 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-9a231c9e-07eb-443d-b50a-2a33feffdd2a req-90b2506f-13b6-478e-94b1-5ef7d3801523 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:46:57 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-9a231c9e-07eb-443d-b50a-2a33feffdd2a req-90b2506f-13b6-478e-94b1-5ef7d3801523 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:46:57 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-9a231c9e-07eb-443d-b50a-2a33feffdd2a req-90b2506f-13b6-478e-94b1-5ef7d3801523 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:46:57 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-9a231c9e-07eb-443d-b50a-2a33feffdd2a req-90b2506f-13b6-478e-94b1-5ef7d3801523 service nova] Creating event network-changed:53647a47-cc0c-42e6-a4c0-c12a1dab3deb for instance f4f0b39a-e99b-4bc7-aecc-24d4f754e674 on user Apr 11 15:46:57 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-9a231c9e-07eb-443d-b50a-2a33feffdd2a req-90b2506f-13b6-478e-94b1-5ef7d3801523 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028256 Apr 11 15:46:57 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 281/848] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:46:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:47:03 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-3a91fe94-6d72-4364-8d60-716a6be9dd5d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:47:03 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-3a91fe94-6d72-4364-8d60-716a6be9dd5d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:47:03 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-3a91fe94-6d72-4364-8d60-716a6be9dd5d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:47:03 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-3a91fe94-6d72-4364-8d60-716a6be9dd5d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:47:03 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-3a91fe94-6d72-4364-8d60-716a6be9dd5d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:47:03 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-3a91fe94-6d72-4364-8d60-716a6be9dd5d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:47:03 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-3a91fe94-6d72-4364-8d60-716a6be9dd5d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:47:03 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-3a91fe94-6d72-4364-8d60-716a6be9dd5d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:47:03 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-3a91fe94-6d72-4364-8d60-716a6be9dd5d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] HTTP exception thrown: Instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd could not be found. Apr 11 15:47:03 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-3a91fe94-6d72-4364-8d60-716a6be9dd5d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Request method failure captured: Apr 11 15:47:03 user devstack@n-api.service[61167]: request: GET /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd HTTP/1.1 Apr 11 15:47:03 user devstack@n-api.service[61167]: Accept: application/json Apr 11 15:47:03 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 15:47:03 user devstack@n-api.service[61167]: Connection: close Apr 11 15:47:03 user devstack@n-api.service[61167]: Content-Length: 0 Apr 11 15:47:03 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 15:47:03 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 15:47:03 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 15:47:03 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 15:47:03 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNX5BcTshUbhWFRlg8t_zz9-lO37xLS5_qPcHcMwZTMQwRt4-or551ovVhKCAIBaCeMNrORffTlZsBlQimdDmzpIuoYxvEBmKfToUDowo0nTS3d21BIn-SO-2Yx-r5ng4wKQzH6UThKxvWXMHzNTatOGJbb71hvxv9ohtGR1eUXPnvUI Apr 11 15:47:03 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 15:47:03 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 15:47:03 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 15:47:03 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 15:47:03 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 15:47:03 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 15:47:03 user devstack@n-api.service[61167]: X-Project-Id: c23461a3d7ca49f6a77d3fde6f1009d3 Apr 11 15:47:03 user devstack@n-api.service[61167]: X-Project-Name: tempest-TestMinimumBasicScenario-673773229 Apr 11 15:47:03 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 15:47:03 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 15:47:03 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c23461a3d7ca49f6a77d3fde6f1009d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c23461a3d7ca49f6a77d3fde6f1009d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c23461a3d7ca49f6a77d3fde6f1009d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:47:03 user devstack@n-api.service[61167]: X-Tenant: tempest-TestMinimumBasicScenario-673773229 Apr 11 15:47:03 user devstack@n-api.service[61167]: X-Tenant-Id: c23461a3d7ca49f6a77d3fde6f1009d3 Apr 11 15:47:03 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-TestMinimumBasicScenario-673773229 Apr 11 15:47:03 user devstack@n-api.service[61167]: X-User: tempest-TestMinimumBasicScenario-673773229-project-member Apr 11 15:47:03 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 15:47:03 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 15:47:03 user devstack@n-api.service[61167]: X-User-Id: 044f17aee3324b3a97bebe935548b3b4 Apr 11 15:47:03 user devstack@n-api.service[61167]: X-User-Name: tempest-TestMinimumBasicScenario-673773229-project-member Apr 11 15:47:03 user devstack@n-api.service[61167]: method: > Apr 11 15:47:03 user devstack@n-api.service[61167]: exception: Instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd could not be found. Apr 11 15:47:03 user devstack@n-api.service[61167]: action_args: {'id': '8e816ce5-4da8-4366-9fa1-c33a45ba87fd'} Apr 11 15:47:03 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd could not be found. Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd could not be found. Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd could not be found. Apr 11 15:47:03 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:47:03 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-3a91fe94-6d72-4364-8d60-716a6be9dd5d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Returning 404 to user: Instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd could not be found. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:47:03 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-3a91fe94-6d72-4364-8d60-716a6be9dd5d tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd" status: 404 len: 111 microversion: 2.1 time: 0.180686 Apr 11 15:47:03 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 287/849] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:47:03 2023] GET /compute/v2.1/servers/8e816ce5-4da8-4366-9fa1-c33a45ba87fd => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:47:03 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-84422eab-136b-4872-bbea-b16eb6c84029 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Calling method '.version_select at 0x7f4c2ebd85e0>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:47:03 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:47:03 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-84422eab-136b-4872-bbea-b16eb6c84029 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-476755655" status: 202 len: 0 microversion: 2.1 time: 0.025839 Apr 11 15:47:03 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 282/850] 10.0.0.210 () {62 vars in 1346 bytes} [Tue Apr 11 15:47:03 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-476755655 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:47:08 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:47:08 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=16,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:47:08 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-c2ab4c59-d43d-456e-ad82-9475138d5f05 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:47:08 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-c2ab4c59-d43d-456e-ad82-9475138d5f05 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:47:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c2ab4c59-d43d-456e-ad82-9475138d5f05 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:47:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c2ab4c59-d43d-456e-ad82-9475138d5f05 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:47:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c2ab4c59-d43d-456e-ad82-9475138d5f05 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:47:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c2ab4c59-d43d-456e-ad82-9475138d5f05 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:47:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c2ab4c59-d43d-456e-ad82-9475138d5f05 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:47:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c2ab4c59-d43d-456e-ad82-9475138d5f05 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:47:09 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-c2ab4c59-d43d-456e-ad82-9475138d5f05 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8492f96e5d4f54aaae3679c82b6759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd700a53aa25849e0afd562b05881d09a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:47:09 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-c2ab4c59-d43d-456e-ad82-9475138d5f05 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" status: 200 len: 1704 microversion: 2.1 time: 0.374985 Apr 11 15:47:09 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 282/851] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:47:08 2023] GET /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a => generated 1704 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:47:09 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-2d0654cf-d228-44da-a039-a5d8ee794063 req-2df48766-0d38-47ea-96d1-e450a1f603bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4f0b39a-e99b-4bc7-aecc-24d4f754e674", "name": "network-vif-plugged", "status": "completed", "tag": "53647a47-cc0c-42e6-a4c0-c12a1dab3deb"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:47:09 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:47:09 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:47:09 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-2d0654cf-d228-44da-a039-a5d8ee794063 req-2df48766-0d38-47ea-96d1-e450a1f603bc service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:47:09 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-2d0654cf-d228-44da-a039-a5d8ee794063 req-2df48766-0d38-47ea-96d1-e450a1f603bc service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:47:09 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-2d0654cf-d228-44da-a039-a5d8ee794063 req-2df48766-0d38-47ea-96d1-e450a1f603bc service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:47:09 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-2d0654cf-d228-44da-a039-a5d8ee794063 req-2df48766-0d38-47ea-96d1-e450a1f603bc service nova] Creating event network-vif-plugged:53647a47-cc0c-42e6-a4c0-c12a1dab3deb for instance f4f0b39a-e99b-4bc7-aecc-24d4f754e674 on user Apr 11 15:47:09 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-2d0654cf-d228-44da-a039-a5d8ee794063 req-2df48766-0d38-47ea-96d1-e450a1f603bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034963 Apr 11 15:47:09 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 288/852] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:47:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:47:11 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-b242a85c-a93f-497f-91de-a8aee224ba6e req-73ec61e0-902a-45e1-a6e6-60fe33327ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4f0b39a-e99b-4bc7-aecc-24d4f754e674", "name": "network-vif-plugged", "status": "completed", "tag": "53647a47-cc0c-42e6-a4c0-c12a1dab3deb"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:47:11 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:47:11 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-b242a85c-a93f-497f-91de-a8aee224ba6e req-73ec61e0-902a-45e1-a6e6-60fe33327ed5 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:47:11 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-b242a85c-a93f-497f-91de-a8aee224ba6e req-73ec61e0-902a-45e1-a6e6-60fe33327ed5 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:47:11 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-b242a85c-a93f-497f-91de-a8aee224ba6e req-73ec61e0-902a-45e1-a6e6-60fe33327ed5 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:47:11 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-b242a85c-a93f-497f-91de-a8aee224ba6e req-73ec61e0-902a-45e1-a6e6-60fe33327ed5 service nova] Creating event network-vif-plugged:53647a47-cc0c-42e6-a4c0-c12a1dab3deb for instance f4f0b39a-e99b-4bc7-aecc-24d4f754e674 on user Apr 11 15:47:11 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-b242a85c-a93f-497f-91de-a8aee224ba6e req-73ec61e0-902a-45e1-a6e6-60fe33327ed5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032180 Apr 11 15:47:11 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 283/853] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:47:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:47:39 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-9eab7b6b-8e4f-46a7-8d89-8d975268c18f tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:47:39 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-9eab7b6b-8e4f-46a7-8d89-8d975268c18f tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:47:39 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:47:39 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:47:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-9eab7b6b-8e4f-46a7-8d89-8d975268c18f tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:47:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-9eab7b6b-8e4f-46a7-8d89-8d975268c18f tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:47:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-9eab7b6b-8e4f-46a7-8d89-8d975268c18f tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:47:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-9eab7b6b-8e4f-46a7-8d89-8d975268c18f tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:47:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-9eab7b6b-8e4f-46a7-8d89-8d975268c18f tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:47:39 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-9eab7b6b-8e4f-46a7-8d89-8d975268c18f tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:47:39 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-9eab7b6b-8e4f-46a7-8d89-8d975268c18f tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.109286 Apr 11 15:47:39 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 283/854] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 15:47:39 2023] GET /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88/os-interface => generated 283 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:47:40 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:47:40 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:47:40 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-1abd0a2c-d306-4750-8f10-bffe85ae3ce2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-329496294"}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:47:40 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-1abd0a2c-d306-4750-8f10-bffe85ae3ce2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:47:40 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:47:40 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:47:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-1abd0a2c-d306-4750-8f10-bffe85ae3ce2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:47:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-1abd0a2c-d306-4750-8f10-bffe85ae3ce2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:47:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-1abd0a2c-d306-4750-8f10-bffe85ae3ce2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:47:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-1abd0a2c-d306-4750-8f10-bffe85ae3ce2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:47:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-1abd0a2c-d306-4750-8f10-bffe85ae3ce2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:47:40 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-1abd0a2c-d306-4750-8f10-bffe85ae3ce2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:47:41 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-f23047c6-923e-452d-ab87-b969c7f32ae8 req-231b019f-eb26-40d5-ae1b-dad7aa09f512 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0fc18ff-897c-4f97-95b6-9f25d11dba88", "tag": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:47:41 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-f23047c6-923e-452d-ab87-b969c7f32ae8 req-231b019f-eb26-40d5-ae1b-dad7aa09f512 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:47:41 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-f23047c6-923e-452d-ab87-b969c7f32ae8 req-231b019f-eb26-40d5-ae1b-dad7aa09f512 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:47:41 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-f23047c6-923e-452d-ab87-b969c7f32ae8 req-231b019f-eb26-40d5-ae1b-dad7aa09f512 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:47:41 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-f23047c6-923e-452d-ab87-b969c7f32ae8 req-231b019f-eb26-40d5-ae1b-dad7aa09f512 service nova] Creating event network-changed:cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 for instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 on user Apr 11 15:47:41 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-f23047c6-923e-452d-ab87-b969c7f32ae8 req-231b019f-eb26-40d5-ae1b-dad7aa09f512 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228379 Apr 11 15:47:41 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 289/855] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:47:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:47:41 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-1abd0a2c-d306-4750-8f10-bffe85ae3ce2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88/action" status: 202 len: 0 microversion: 2.1 time: 0.960963 Apr 11 15:47:41 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 284/856] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 15:47:40 2023] POST /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88/action => generated 0 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 11 15:47:41 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-0a0cdd8e-1d8e-4f08-a4ff-dba87de3d4a2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Calling method '.version_select at 0x7f4c2ed76dd0>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:47:41 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-0a0cdd8e-1d8e-4f08-a4ff-dba87de3d4a2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] 10.0.0.210 "GET /compute/v2.1/images/914ad610-2e93-41cc-9c53-514927e371f8" status: 200 len: 1610 microversion: 2.1 time: 0.046816 Apr 11 15:47:41 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 284/857] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 11 15:47:41 2023] GET /compute/v2.1/images/914ad610-2e93-41cc-9c53-514927e371f8 => generated 1610 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:47:45 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-a9ab339d-fbb3-444c-b491-15c07e4849fe tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:47:45 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-a9ab339d-fbb3-444c-b491-15c07e4849fe tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:47:45 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-a9ab339d-fbb3-444c-b491-15c07e4849fe tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:47:45 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-a9ab339d-fbb3-444c-b491-15c07e4849fe tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:47:45 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-a9ab339d-fbb3-444c-b491-15c07e4849fe tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:47:45 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-a9ab339d-fbb3-444c-b491-15c07e4849fe tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:47:45 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-a9ab339d-fbb3-444c-b491-15c07e4849fe tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:47:45 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-a9ab339d-fbb3-444c-b491-15c07e4849fe tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:47:45 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-a9ab339d-fbb3-444c-b491-15c07e4849fe tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2110b74f38642afa560e1c9790d3f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312851c65ba1434691eca0cd2a8cd6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:47:45 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-a9ab339d-fbb3-444c-b491-15c07e4849fe tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f4f0b39a-e99b-4bc7-aecc-24d4f754e674" status: 200 len: 1552 microversion: 2.1 time: 0.504968 Apr 11 15:47:45 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 290/858] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:47:45 2023] GET /compute/v2.1/servers/f4f0b39a-e99b-4bc7-aecc-24d4f754e674 => generated 1552 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:48:09 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:48:09 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:48:09 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-e826ffec-99cf-432b-9216-6de3728f4929 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:48:09 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-e826ffec-99cf-432b-9216-6de3728f4929 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:48:09 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e826ffec-99cf-432b-9216-6de3728f4929 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:48:09 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e826ffec-99cf-432b-9216-6de3728f4929 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:48:09 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e826ffec-99cf-432b-9216-6de3728f4929 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:48:09 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e826ffec-99cf-432b-9216-6de3728f4929 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:48:09 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e826ffec-99cf-432b-9216-6de3728f4929 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:48:09 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e826ffec-99cf-432b-9216-6de3728f4929 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:48:09 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-e826ffec-99cf-432b-9216-6de3728f4929 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] HTTP exception thrown: Cannot 'detach_volume' instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a while it is in vm_state rescued Apr 11 15:48:09 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-e826ffec-99cf-432b-9216-6de3728f4929 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Request method failure captured: Apr 11 15:48:09 user devstack@n-api.service[61165]: request: DELETE /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/os-volume_attachments/a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 HTTP/1.1 Apr 11 15:48:09 user devstack@n-api.service[61165]: Accept: application/json Apr 11 15:48:09 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 15:48:09 user devstack@n-api.service[61165]: Connection: close Apr 11 15:48:09 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 15:48:09 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 15:48:09 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 15:48:09 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 15:48:09 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 15:48:09 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNX5Xpp64UjUCTvokQPchz3Z_zzZld6Gzzdi5g5f3dAzZMYNbfpuD5SVzUtCVXDSbv-6uA4tdlV5bq4l7Mfh7qU6Z3TnkgMq20ehg7ZRY4FWJXSHNtB12atJ6Is1L1bASyUvXy3UohCr63-e-VGzFJVGpcxBwakeRjEJokogPDcce5GQ Apr 11 15:48:09 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 15:48:09 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 15:48:09 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 15:48:09 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 15:48:09 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 15:48:09 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 15:48:09 user devstack@n-api.service[61165]: X-Project-Id: d700a53aa25849e0afd562b05881d09a Apr 11 15:48:09 user devstack@n-api.service[61165]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1491000769 Apr 11 15:48:09 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 15:48:09 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 15:48:09 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d700a53aa25849e0afd562b05881d09a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d700a53aa25849e0afd562b05881d09a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d700a53aa25849e0afd562b05881d09a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:48:09 user devstack@n-api.service[61165]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1491000769 Apr 11 15:48:09 user devstack@n-api.service[61165]: X-Tenant-Id: d700a53aa25849e0afd562b05881d09a Apr 11 15:48:09 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1491000769 Apr 11 15:48:09 user devstack@n-api.service[61165]: X-User: tempest-ServerRescueNegativeTestJSON-1491000769-project-member Apr 11 15:48:09 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 15:48:09 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 15:48:09 user devstack@n-api.service[61165]: X-User-Id: 5c8492f96e5d4f54aaae3679c82b6759 Apr 11 15:48:09 user devstack@n-api.service[61165]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1491000769-project-member Apr 11 15:48:09 user devstack@n-api.service[61165]: method: > Apr 11 15:48:09 user devstack@n-api.service[61165]: exception: Cannot 'detach_volume' instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a while it is in vm_state rescued Apr 11 15:48:09 user devstack@n-api.service[61165]: action_args: {'server_id': 'c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a', 'id': 'a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3'} Apr 11 15:48:09 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:48:09 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:48:09 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 11 15:48:09 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 11 15:48:09 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 11 15:48:09 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 11 15:48:09 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 11 15:48:09 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 11 15:48:09 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 11 15:48:09 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:48:09 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:48:09 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:48:09 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:48:09 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:48:09 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:48:09 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:48:09 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:48:09 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:48:09 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:48:09 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 11 15:48:09 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 11 15:48:09 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 11 15:48:09 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 11 15:48:09 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a while it is in vm_state rescued Apr 11 15:48:09 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:48:09 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:48:09 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:48:09 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:48:09 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:48:09 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:48:09 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:48:09 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:48:09 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a while it is in vm_state rescued Apr 11 15:48:09 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:48:09 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-e826ffec-99cf-432b-9216-6de3728f4929 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Returning 409 to user: Cannot 'detach_volume' instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a while it is in vm_state rescued {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:48:09 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-e826ffec-99cf-432b-9216-6de3728f4929 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/os-volume_attachments/a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3" status: 409 len: 152 microversion: 2.1 time: 0.162973 Apr 11 15:48:09 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 285/859] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 15:48:09 2023] DELETE /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/os-volume_attachments/a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 => generated 152 bytes in 164 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 11 15:48:09 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:48:09 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:48:09 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-83baa33a-08fa-4e72-a54f-7bf7cf21ebeb tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:48:09 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-83baa33a-08fa-4e72-a54f-7bf7cf21ebeb tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:48:09 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-83baa33a-08fa-4e72-a54f-7bf7cf21ebeb tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:48:09 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-83baa33a-08fa-4e72-a54f-7bf7cf21ebeb tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:48:09 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-83baa33a-08fa-4e72-a54f-7bf7cf21ebeb tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:48:09 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-83baa33a-08fa-4e72-a54f-7bf7cf21ebeb tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:48:09 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-83baa33a-08fa-4e72-a54f-7bf7cf21ebeb tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:48:09 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-83baa33a-08fa-4e72-a54f-7bf7cf21ebeb tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:48:09 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-83baa33a-08fa-4e72-a54f-7bf7cf21ebeb tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/action" status: 202 len: 0 microversion: 2.1 time: 0.079867 Apr 11 15:48:09 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 285/860] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 15:48:09 2023] POST /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:48:09 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-1c7a6e98-1f0a-4abd-9fec-05726591d546 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:48:09 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-1c7a6e98-1f0a-4abd-9fec-05726591d546 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:48:09 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=4 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:48:09 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=8 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:48:09 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1c7a6e98-1f0a-4abd-9fec-05726591d546 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:48:09 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1c7a6e98-1f0a-4abd-9fec-05726591d546 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:48:09 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1c7a6e98-1f0a-4abd-9fec-05726591d546 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:48:09 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1c7a6e98-1f0a-4abd-9fec-05726591d546 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:48:09 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1c7a6e98-1f0a-4abd-9fec-05726591d546 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:48:09 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-1c7a6e98-1f0a-4abd-9fec-05726591d546 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:48:09 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-1c7a6e98-1f0a-4abd-9fec-05726591d546 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8492f96e5d4f54aaae3679c82b6759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd700a53aa25849e0afd562b05881d09a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:48:09 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-1c7a6e98-1f0a-4abd-9fec-05726591d546 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" status: 200 len: 1712 microversion: 2.1 time: 0.159271 Apr 11 15:48:09 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 291/861] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:48:09 2023] GET /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a => generated 1712 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:48:10 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-a9e765ac-1589-4fd2-957f-ecd2fe68e823 req-50d66337-a338-4a1d-a409-c052cecde4d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a", "name": "network-vif-unplugged", "status": "completed", "tag": "35ac8f6f-2998-4274-ab63-df7086194703"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:48:10 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-a9e765ac-1589-4fd2-957f-ecd2fe68e823 req-50d66337-a338-4a1d-a409-c052cecde4d8 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:48:10 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-a9e765ac-1589-4fd2-957f-ecd2fe68e823 req-50d66337-a338-4a1d-a409-c052cecde4d8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:48:10 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-a9e765ac-1589-4fd2-957f-ecd2fe68e823 req-50d66337-a338-4a1d-a409-c052cecde4d8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:48:10 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-a9e765ac-1589-4fd2-957f-ecd2fe68e823 req-50d66337-a338-4a1d-a409-c052cecde4d8 service nova] Creating event network-vif-unplugged:35ac8f6f-2998-4274-ab63-df7086194703 for instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a on user Apr 11 15:48:10 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-a9e765ac-1589-4fd2-957f-ecd2fe68e823 req-50d66337-a338-4a1d-a409-c052cecde4d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031067 Apr 11 15:48:10 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 286/862] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:48:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:48:12 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-3fb1f628-d8bb-4e9d-8c4e-d9c3ff4958b5 req-a503a3c3-f8d3-4bb3-b263-41bdf0652272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a", "name": "network-vif-plugged", "status": "completed", "tag": "35ac8f6f-2998-4274-ab63-df7086194703"}, {"server_uuid": "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a", "name": "network-vif-plugged", "status": "completed", "tag": "35ac8f6f-2998-4274-ab63-df7086194703"}, {"server_uuid": "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a", "name": "network-vif-plugged", "status": "completed", "tag": "35ac8f6f-2998-4274-ab63-df7086194703"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:48:12 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-3fb1f628-d8bb-4e9d-8c4e-d9c3ff4958b5 req-a503a3c3-f8d3-4bb3-b263-41bdf0652272 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:48:12 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-3fb1f628-d8bb-4e9d-8c4e-d9c3ff4958b5 req-a503a3c3-f8d3-4bb3-b263-41bdf0652272 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:48:12 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-3fb1f628-d8bb-4e9d-8c4e-d9c3ff4958b5 req-a503a3c3-f8d3-4bb3-b263-41bdf0652272 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:48:12 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-3fb1f628-d8bb-4e9d-8c4e-d9c3ff4958b5 req-a503a3c3-f8d3-4bb3-b263-41bdf0652272 service nova] Creating event network-vif-plugged:35ac8f6f-2998-4274-ab63-df7086194703 for instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a on user Apr 11 15:48:12 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-3fb1f628-d8bb-4e9d-8c4e-d9c3ff4958b5 req-a503a3c3-f8d3-4bb3-b263-41bdf0652272 service nova] Creating event network-vif-plugged:35ac8f6f-2998-4274-ab63-df7086194703 for instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a on user Apr 11 15:48:12 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-3fb1f628-d8bb-4e9d-8c4e-d9c3ff4958b5 req-a503a3c3-f8d3-4bb3-b263-41bdf0652272 service nova] Creating event network-vif-plugged:35ac8f6f-2998-4274-ab63-df7086194703 for instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a on user Apr 11 15:48:12 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-3fb1f628-d8bb-4e9d-8c4e-d9c3ff4958b5 req-a503a3c3-f8d3-4bb3-b263-41bdf0652272 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.035799 Apr 11 15:48:12 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 286/863] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:48:12 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:48:31 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-2d363173-5930-42a5-ad97-59cd0062b737 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Calling method '.version_select at 0x7f4c2ecda200>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:48:31 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:48:31 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:48:31 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-2d363173-5930-42a5-ad97-59cd0062b737 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] 10.0.0.210 "GET /compute/v2.1/images/914ad610-2e93-41cc-9c53-514927e371f8" status: 200 len: 1724 microversion: 2.1 time: 0.062732 Apr 11 15:48:31 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 292/864] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 11 15:48:31 2023] GET /compute/v2.1/images/914ad610-2e93-41cc-9c53-514927e371f8 => generated 1724 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:48:32 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:48:32 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=8 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:48:32 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-a51062a7-5165-4778-90e4-af25068f6c0d tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Calling method '.version_select at 0x7f4c2ebd92d0>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:48:32 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-a51062a7-5165-4778-90e4-af25068f6c0d tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] 10.0.0.210 "GET /compute/v2.1/images/914ad610-2e93-41cc-9c53-514927e371f8" status: 200 len: 1724 microversion: 2.1 time: 0.059118 Apr 11 15:48:32 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 287/865] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 11 15:48:32 2023] GET /compute/v2.1/images/914ad610-2e93-41cc-9c53-514927e371f8 => generated 1724 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:48:32 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:48:32 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:48:32 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-c6f699d8-6230-45d6-8a3f-1b3260ff34cc tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:48:32 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-c6f699d8-6230-45d6-8a3f-1b3260ff34cc tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:48:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c6f699d8-6230-45d6-8a3f-1b3260ff34cc tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:48:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c6f699d8-6230-45d6-8a3f-1b3260ff34cc tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:48:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c6f699d8-6230-45d6-8a3f-1b3260ff34cc tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:48:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c6f699d8-6230-45d6-8a3f-1b3260ff34cc tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:48:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c6f699d8-6230-45d6-8a3f-1b3260ff34cc tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:48:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c6f699d8-6230-45d6-8a3f-1b3260ff34cc tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:48:32 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-c6f699d8-6230-45d6-8a3f-1b3260ff34cc tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b244004380d43699c5a06e817224b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c9dbdbc7b641f096dc292ea7bf7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:48:32 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-c6f699d8-6230-45d6-8a3f-1b3260ff34cc tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88" status: 200 len: 1672 microversion: 2.1 time: 0.186606 Apr 11 15:48:32 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 287/866] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:48:32 2023] GET /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88 => generated 1672 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:48:45 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-bfaeac4a-5230-4b8d-93d3-fad7466d1afb tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:48:45 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-bfaeac4a-5230-4b8d-93d3-fad7466d1afb tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:48:45 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-bfaeac4a-5230-4b8d-93d3-fad7466d1afb tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:48:45 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-bfaeac4a-5230-4b8d-93d3-fad7466d1afb tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:48:45 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-bfaeac4a-5230-4b8d-93d3-fad7466d1afb tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:48:45 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-bfaeac4a-5230-4b8d-93d3-fad7466d1afb tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:48:45 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-bfaeac4a-5230-4b8d-93d3-fad7466d1afb tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:48:45 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-bfaeac4a-5230-4b8d-93d3-fad7466d1afb tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:48:45 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-bfaeac4a-5230-4b8d-93d3-fad7466d1afb tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2110b74f38642afa560e1c9790d3f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312851c65ba1434691eca0cd2a8cd6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:48:45 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-bfaeac4a-5230-4b8d-93d3-fad7466d1afb tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f4f0b39a-e99b-4bc7-aecc-24d4f754e674" status: 200 len: 1552 microversion: 2.1 time: 0.154033 Apr 11 15:48:45 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 293/867] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:48:45 2023] GET /compute/v2.1/servers/f4f0b39a-e99b-4bc7-aecc-24d4f754e674 => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:48:46 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:48:46 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:48:46 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:48:46 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:48:46 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:48:46 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:48:46 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:48:46 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:48:46 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Going to try to terminate instance {{(pid=61165) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:48:46 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f4f0b39a-e99b-4bc7-aecc-24d4f754e674" status: 204 len: 0 microversion: 2.1 time: 0.115264 Apr 11 15:48:46 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 288/868] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:48:46 2023] DELETE /compute/v2.1/servers/f4f0b39a-e99b-4bc7-aecc-24d4f754e674 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:48:46 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-34856740-c252-48aa-b097-607f2e19d943 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:48:46 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-34856740-c252-48aa-b097-607f2e19d943 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:48:46 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:48:46 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:48:46 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-34856740-c252-48aa-b097-607f2e19d943 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:48:46 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-34856740-c252-48aa-b097-607f2e19d943 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:48:46 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-34856740-c252-48aa-b097-607f2e19d943 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:48:46 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-34856740-c252-48aa-b097-607f2e19d943 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:48:46 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-34856740-c252-48aa-b097-607f2e19d943 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:48:46 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-34856740-c252-48aa-b097-607f2e19d943 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:48:46 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-34856740-c252-48aa-b097-607f2e19d943 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2110b74f38642afa560e1c9790d3f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312851c65ba1434691eca0cd2a8cd6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:48:46 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-34856740-c252-48aa-b097-607f2e19d943 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f4f0b39a-e99b-4bc7-aecc-24d4f754e674" status: 200 len: 1558 microversion: 2.1 time: 0.193609 Apr 11 15:48:46 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 288/869] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:48:46 2023] GET /compute/v2.1/servers/f4f0b39a-e99b-4bc7-aecc-24d4f754e674 => generated 1558 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:48:46 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-4674821c-b41b-4f3b-9e27-f393c75bbf28 req-723680c6-c3e7-4e2d-a310-3c67b447c176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4f0b39a-e99b-4bc7-aecc-24d4f754e674", "name": "network-vif-unplugged", "status": "completed", "tag": "53647a47-cc0c-42e6-a4c0-c12a1dab3deb"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:48:46 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-4674821c-b41b-4f3b-9e27-f393c75bbf28 req-723680c6-c3e7-4e2d-a310-3c67b447c176 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:48:46 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-4674821c-b41b-4f3b-9e27-f393c75bbf28 req-723680c6-c3e7-4e2d-a310-3c67b447c176 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:48:46 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-4674821c-b41b-4f3b-9e27-f393c75bbf28 req-723680c6-c3e7-4e2d-a310-3c67b447c176 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:48:46 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-4674821c-b41b-4f3b-9e27-f393c75bbf28 req-723680c6-c3e7-4e2d-a310-3c67b447c176 service nova] Creating event network-vif-unplugged:53647a47-cc0c-42e6-a4c0-c12a1dab3deb for instance f4f0b39a-e99b-4bc7-aecc-24d4f754e674 on user Apr 11 15:48:46 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-4674821c-b41b-4f3b-9e27-f393c75bbf28 req-723680c6-c3e7-4e2d-a310-3c67b447c176 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051723 Apr 11 15:48:46 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 294/870] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:48:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:48:47 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-103f61a7-cc96-48d2-a96f-d0e1ec750485 req-907cbbe6-c036-4e17-ba89-3f0d4f148152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4f0b39a-e99b-4bc7-aecc-24d4f754e674", "name": "network-vif-deleted", "tag": "53647a47-cc0c-42e6-a4c0-c12a1dab3deb"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:48:47 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-103f61a7-cc96-48d2-a96f-d0e1ec750485 req-907cbbe6-c036-4e17-ba89-3f0d4f148152 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:48:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-103f61a7-cc96-48d2-a96f-d0e1ec750485 req-907cbbe6-c036-4e17-ba89-3f0d4f148152 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:48:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-103f61a7-cc96-48d2-a96f-d0e1ec750485 req-907cbbe6-c036-4e17-ba89-3f0d4f148152 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:48:48 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-103f61a7-cc96-48d2-a96f-d0e1ec750485 req-907cbbe6-c036-4e17-ba89-3f0d4f148152 service nova] Creating event network-vif-deleted:53647a47-cc0c-42e6-a4c0-c12a1dab3deb for instance f4f0b39a-e99b-4bc7-aecc-24d4f754e674 on user Apr 11 15:48:48 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-103f61a7-cc96-48d2-a96f-d0e1ec750485 req-907cbbe6-c036-4e17-ba89-3f0d4f148152 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123313 Apr 11 15:48:48 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 289/871] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:48:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:48:48 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4f0b39a-e99b-4bc7-aecc-24d4f754e674", "name": "network-vif-plugged", "status": "completed", "tag": "53647a47-cc0c-42e6-a4c0-c12a1dab3deb"}, {"server_uuid": "f4f0b39a-e99b-4bc7-aecc-24d4f754e674", "name": "network-vif-plugged", "status": "completed", "tag": "53647a47-cc0c-42e6-a4c0-c12a1dab3deb"}, {"server_uuid": "f4f0b39a-e99b-4bc7-aecc-24d4f754e674", "name": "network-vif-plugged", "status": "completed", "tag": "53647a47-cc0c-42e6-a4c0-c12a1dab3deb"}, {"server_uuid": "f4f0b39a-e99b-4bc7-aecc-24d4f754e674", "name": "network-vif-unplugged", "status": "completed", "tag": "53647a47-cc0c-42e6-a4c0-c12a1dab3deb"}, {"server_uuid": "f4f0b39a-e99b-4bc7-aecc-24d4f754e674", "name": "network-vif-plugged", "status": "completed", "tag": "53647a47-cc0c-42e6-a4c0-c12a1dab3deb"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:48:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:48:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:48:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:48:48 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] Creating event network-vif-plugged:53647a47-cc0c-42e6-a4c0-c12a1dab3deb for instance f4f0b39a-e99b-4bc7-aecc-24d4f754e674 on user Apr 11 15:48:48 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] Creating event network-vif-plugged:53647a47-cc0c-42e6-a4c0-c12a1dab3deb for instance f4f0b39a-e99b-4bc7-aecc-24d4f754e674 on user Apr 11 15:48:48 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] Creating event network-vif-plugged:53647a47-cc0c-42e6-a4c0-c12a1dab3deb for instance f4f0b39a-e99b-4bc7-aecc-24d4f754e674 on user Apr 11 15:48:48 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] Creating event network-vif-unplugged:53647a47-cc0c-42e6-a4c0-c12a1dab3deb for instance f4f0b39a-e99b-4bc7-aecc-24d4f754e674 on user Apr 11 15:48:48 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] Creating event network-vif-plugged:53647a47-cc0c-42e6-a4c0-c12a1dab3deb for instance f4f0b39a-e99b-4bc7-aecc-24d4f754e674 on user Apr 11 15:48:48 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.031852 Apr 11 15:48:48 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 289/872] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:48:48 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:48:59 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=4 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:48:59 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=8 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:48:59 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-c8fa9e04-a076-4bd1-8e88-203b71416258 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:48:59 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-c8fa9e04-a076-4bd1-8e88-203b71416258 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:48:59 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c8fa9e04-a076-4bd1-8e88-203b71416258 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:48:59 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c8fa9e04-a076-4bd1-8e88-203b71416258 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:48:59 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c8fa9e04-a076-4bd1-8e88-203b71416258 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:48:59 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c8fa9e04-a076-4bd1-8e88-203b71416258 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:48:59 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c8fa9e04-a076-4bd1-8e88-203b71416258 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:48:59 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c8fa9e04-a076-4bd1-8e88-203b71416258 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:48:59 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-c8fa9e04-a076-4bd1-8e88-203b71416258 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8492f96e5d4f54aaae3679c82b6759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd700a53aa25849e0afd562b05881d09a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:48:59 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-c8fa9e04-a076-4bd1-8e88-203b71416258 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" status: 200 len: 1718 microversion: 2.1 time: 0.144484 Apr 11 15:48:59 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 295/873] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:48:59 2023] GET /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a => generated 1718 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:49:32 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:49:32 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:49:32 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-cd5422eb-4bf2-49f4-8582-703546a99097 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:49:32 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-cd5422eb-4bf2-49f4-8582-703546a99097 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:49:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cd5422eb-4bf2-49f4-8582-703546a99097 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:49:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cd5422eb-4bf2-49f4-8582-703546a99097 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:49:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cd5422eb-4bf2-49f4-8582-703546a99097 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:49:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cd5422eb-4bf2-49f4-8582-703546a99097 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:49:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cd5422eb-4bf2-49f4-8582-703546a99097 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:49:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cd5422eb-4bf2-49f4-8582-703546a99097 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:49:32 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-cd5422eb-4bf2-49f4-8582-703546a99097 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b244004380d43699c5a06e817224b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c9dbdbc7b641f096dc292ea7bf7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:49:32 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-cd5422eb-4bf2-49f4-8582-703546a99097 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88" status: 200 len: 1672 microversion: 2.1 time: 0.176429 Apr 11 15:49:32 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 290/874] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:49:32 2023] GET /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88 => generated 1672 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:49:34 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:49:34 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=8 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:49:34 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5da66830-cebd-441e-8573-1480f8fe8e15"}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:49:34 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:49:34 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:49:34 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:49:34 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:49:34 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:49:34 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:49:34 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:49:34 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.336022 Apr 11 15:49:34 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 290/875] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 15:49:34 2023] POST /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88/os-volume_attachments => generated 194 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:49:36 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-74c8ad71-79b9-4a55-9e7d-3b021caddcd3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:49:36 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-74c8ad71-79b9-4a55-9e7d-3b021caddcd3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:49:36 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:49:36 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:49:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-74c8ad71-79b9-4a55-9e7d-3b021caddcd3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:49:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-74c8ad71-79b9-4a55-9e7d-3b021caddcd3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:49:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-74c8ad71-79b9-4a55-9e7d-3b021caddcd3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:49:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-74c8ad71-79b9-4a55-9e7d-3b021caddcd3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:49:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-74c8ad71-79b9-4a55-9e7d-3b021caddcd3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:49:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-74c8ad71-79b9-4a55-9e7d-3b021caddcd3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:49:36 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-74c8ad71-79b9-4a55-9e7d-3b021caddcd3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] HTTP exception thrown: Instance f4f0b39a-e99b-4bc7-aecc-24d4f754e674 could not be found. Apr 11 15:49:36 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-74c8ad71-79b9-4a55-9e7d-3b021caddcd3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Request method failure captured: Apr 11 15:49:36 user devstack@n-api.service[61167]: request: GET /compute/v2.1/servers/f4f0b39a-e99b-4bc7-aecc-24d4f754e674 HTTP/1.1 Apr 11 15:49:36 user devstack@n-api.service[61167]: Accept: application/json Apr 11 15:49:36 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 15:49:36 user devstack@n-api.service[61167]: Connection: close Apr 11 15:49:36 user devstack@n-api.service[61167]: Content-Length: 0 Apr 11 15:49:36 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 15:49:36 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 15:49:36 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 15:49:36 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 15:49:36 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNX_MfySgeWQGetehYkoHqYg1G1945hTNCEJ0iZ6MzpnT3yZAJa_LjZxGoo77mYeoWNM22txPKHxqCAJQHMF1JaEqPSco0vUdydRE47pwKZna0AOIEDnSU3nak09PN7xX11kpifNQbUB7HIx3dygnGm9WJh4EQWIeaVGEcb-QhV49Vog Apr 11 15:49:36 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 15:49:36 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 15:49:36 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 15:49:36 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 15:49:36 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 15:49:36 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 15:49:36 user devstack@n-api.service[61167]: X-Project-Id: 312851c65ba1434691eca0cd2a8cd6d2 Apr 11 15:49:36 user devstack@n-api.service[61167]: X-Project-Name: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:49:36 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 15:49:36 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 15:49:36 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:49:36 user devstack@n-api.service[61167]: X-Tenant: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:49:36 user devstack@n-api.service[61167]: X-Tenant-Id: 312851c65ba1434691eca0cd2a8cd6d2 Apr 11 15:49:36 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:49:36 user devstack@n-api.service[61167]: X-User: tempest-TestVolumeBootPattern-1933582504-project-member Apr 11 15:49:36 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 15:49:36 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 15:49:36 user devstack@n-api.service[61167]: X-User-Id: c2110b74f38642afa560e1c9790d3f81 Apr 11 15:49:36 user devstack@n-api.service[61167]: X-User-Name: tempest-TestVolumeBootPattern-1933582504-project-member Apr 11 15:49:36 user devstack@n-api.service[61167]: method: > Apr 11 15:49:36 user devstack@n-api.service[61167]: exception: Instance f4f0b39a-e99b-4bc7-aecc-24d4f754e674 could not be found. Apr 11 15:49:36 user devstack@n-api.service[61167]: action_args: {'id': 'f4f0b39a-e99b-4bc7-aecc-24d4f754e674'} Apr 11 15:49:36 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4f0b39a-e99b-4bc7-aecc-24d4f754e674 could not be found. Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4f0b39a-e99b-4bc7-aecc-24d4f754e674 could not be found. Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4f0b39a-e99b-4bc7-aecc-24d4f754e674 could not be found. Apr 11 15:49:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:49:36 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-74c8ad71-79b9-4a55-9e7d-3b021caddcd3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Returning 404 to user: Instance f4f0b39a-e99b-4bc7-aecc-24d4f754e674 could not be found. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:49:36 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-74c8ad71-79b9-4a55-9e7d-3b021caddcd3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f4f0b39a-e99b-4bc7-aecc-24d4f754e674" status: 404 len: 111 microversion: 2.1 time: 0.038598 Apr 11 15:49:36 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 296/876] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:49:36 2023] GET /compute/v2.1/servers/f4f0b39a-e99b-4bc7-aecc-24d4f754e674 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:49:37 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:49:37 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:49:37 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:49:37 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:49:37 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:49:37 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:49:37 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:49:37 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:49:37 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Going to try to terminate instance {{(pid=61165) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:49:37 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d" status: 204 len: 0 microversion: 2.1 time: 0.125184 Apr 11 15:49:37 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 291/877] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:49:37 2023] DELETE /compute/v2.1/servers/07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:49:37 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-80f065b1-f2c5-4324-a352-b5444b9aabad tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:49:37 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-80f065b1-f2c5-4324-a352-b5444b9aabad tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:49:37 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-80f065b1-f2c5-4324-a352-b5444b9aabad tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:49:37 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-80f065b1-f2c5-4324-a352-b5444b9aabad tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:49:37 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-80f065b1-f2c5-4324-a352-b5444b9aabad tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:49:37 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-80f065b1-f2c5-4324-a352-b5444b9aabad tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:49:37 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-80f065b1-f2c5-4324-a352-b5444b9aabad tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:49:37 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-80f065b1-f2c5-4324-a352-b5444b9aabad tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:49:38 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-80f065b1-f2c5-4324-a352-b5444b9aabad tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2110b74f38642afa560e1c9790d3f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312851c65ba1434691eca0cd2a8cd6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:49:38 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-80f065b1-f2c5-4324-a352-b5444b9aabad tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d" status: 200 len: 1400 microversion: 2.1 time: 0.167638 Apr 11 15:49:38 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 291/878] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:49:37 2023] GET /compute/v2.1/servers/07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d => generated 1400 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:49:38 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-e5b032b9-06d9-4929-b3cd-1ffec2bdc572 req-19a804eb-757d-4c7d-8d5a-cf4de2a98a45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d", "name": "network-vif-unplugged", "status": "completed", "tag": "8eaf93f6-bd22-4804-8044-4cd18b84370a"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:49:38 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-e5b032b9-06d9-4929-b3cd-1ffec2bdc572 req-19a804eb-757d-4c7d-8d5a-cf4de2a98a45 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:49:38 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-e5b032b9-06d9-4929-b3cd-1ffec2bdc572 req-19a804eb-757d-4c7d-8d5a-cf4de2a98a45 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:49:38 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-e5b032b9-06d9-4929-b3cd-1ffec2bdc572 req-19a804eb-757d-4c7d-8d5a-cf4de2a98a45 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:49:38 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-e5b032b9-06d9-4929-b3cd-1ffec2bdc572 req-19a804eb-757d-4c7d-8d5a-cf4de2a98a45 service nova] Creating event network-vif-unplugged:8eaf93f6-bd22-4804-8044-4cd18b84370a for instance 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d on user Apr 11 15:49:38 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-e5b032b9-06d9-4929-b3cd-1ffec2bdc572 req-19a804eb-757d-4c7d-8d5a-cf4de2a98a45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029819 Apr 11 15:49:38 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 297/879] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:49:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:49:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-ac932e59-d139-483f-b180-554f7dad4ae2 req-b9bf91af-e641-4a23-900b-0e0ded9690bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d", "name": "network-vif-deleted", "tag": "8eaf93f6-bd22-4804-8044-4cd18b84370a"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:49:39 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-ac932e59-d139-483f-b180-554f7dad4ae2 req-b9bf91af-e641-4a23-900b-0e0ded9690bb service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:49:39 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-ac932e59-d139-483f-b180-554f7dad4ae2 req-b9bf91af-e641-4a23-900b-0e0ded9690bb service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:49:39 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-ac932e59-d139-483f-b180-554f7dad4ae2 req-b9bf91af-e641-4a23-900b-0e0ded9690bb service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:49:39 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-ac932e59-d139-483f-b180-554f7dad4ae2 req-b9bf91af-e641-4a23-900b-0e0ded9690bb service nova] Creating event network-vif-deleted:8eaf93f6-bd22-4804-8044-4cd18b84370a for instance 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d on user Apr 11 15:49:39 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-ac932e59-d139-483f-b180-554f7dad4ae2 req-b9bf91af-e641-4a23-900b-0e0ded9690bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031014 Apr 11 15:49:39 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 292/880] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:49:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:49:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-03c0bc00-0fc2-4697-8d5d-f7b6a864628d req-28fc6019-4ec7-433f-8205-9acd767e90a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d", "name": "network-vif-plugged", "status": "completed", "tag": "8eaf93f6-bd22-4804-8044-4cd18b84370a"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:49:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-03c0bc00-0fc2-4697-8d5d-f7b6a864628d req-28fc6019-4ec7-433f-8205-9acd767e90a7 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:49:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-03c0bc00-0fc2-4697-8d5d-f7b6a864628d req-28fc6019-4ec7-433f-8205-9acd767e90a7 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:49:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-03c0bc00-0fc2-4697-8d5d-f7b6a864628d req-28fc6019-4ec7-433f-8205-9acd767e90a7 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:49:40 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-03c0bc00-0fc2-4697-8d5d-f7b6a864628d req-28fc6019-4ec7-433f-8205-9acd767e90a7 service nova] Creating event network-vif-plugged:8eaf93f6-bd22-4804-8044-4cd18b84370a for instance 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d on user Apr 11 15:49:40 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-03c0bc00-0fc2-4697-8d5d-f7b6a864628d req-28fc6019-4ec7-433f-8205-9acd767e90a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029367 Apr 11 15:49:40 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 292/881] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:49:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:49:41 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "914ad610-2e93-41cc-9c53-514927e371f8"}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:49:41 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:49:41 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:49:41 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:49:41 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:49:41 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:49:41 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:49:41 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:49:41 user devstack@n-api.service[61167]: DEBUG nova.objects.instance [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lazy-loading 'flavor' on Instance uuid f0fc18ff-897c-4f97-95b6-9f25d11dba88 {{(pid=61167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 15:49:41 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88/action" status: 200 len: 29 microversion: 2.1 time: 0.200665 Apr 11 15:49:41 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 298/882] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 15:49:41 2023] POST /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88/action => generated 29 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 15:49:41 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-750a4864-5f79-4fa4-8f00-f858ed8b1c6c tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:49:41 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-750a4864-5f79-4fa4-8f00-f858ed8b1c6c tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:49:41 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-750a4864-5f79-4fa4-8f00-f858ed8b1c6c tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:49:41 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-750a4864-5f79-4fa4-8f00-f858ed8b1c6c tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:49:41 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-750a4864-5f79-4fa4-8f00-f858ed8b1c6c tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:49:41 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-750a4864-5f79-4fa4-8f00-f858ed8b1c6c tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:49:41 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-750a4864-5f79-4fa4-8f00-f858ed8b1c6c tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:49:41 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-750a4864-5f79-4fa4-8f00-f858ed8b1c6c tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:49:41 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-750a4864-5f79-4fa4-8f00-f858ed8b1c6c tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b244004380d43699c5a06e817224b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c9dbdbc7b641f096dc292ea7bf7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:49:41 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-750a4864-5f79-4fa4-8f00-f858ed8b1c6c tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88" status: 200 len: 1724 microversion: 2.1 time: 0.138622 Apr 11 15:49:41 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 293/883] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:49:41 2023] GET /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88 => generated 1724 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:49:42 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-94b6a292-f3c6-48a3-94c9-8f1ba5c4be40 req-60ba9d0c-bce0-4c9d-ac1b-41a8700cb6c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0fc18ff-897c-4f97-95b6-9f25d11dba88", "name": "network-vif-unplugged", "status": "completed", "tag": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:49:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-94b6a292-f3c6-48a3-94c9-8f1ba5c4be40 req-60ba9d0c-bce0-4c9d-ac1b-41a8700cb6c7 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:49:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-94b6a292-f3c6-48a3-94c9-8f1ba5c4be40 req-60ba9d0c-bce0-4c9d-ac1b-41a8700cb6c7 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:49:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-94b6a292-f3c6-48a3-94c9-8f1ba5c4be40 req-60ba9d0c-bce0-4c9d-ac1b-41a8700cb6c7 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:49:42 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-94b6a292-f3c6-48a3-94c9-8f1ba5c4be40 req-60ba9d0c-bce0-4c9d-ac1b-41a8700cb6c7 service nova] Creating event network-vif-unplugged:cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 for instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 on user Apr 11 15:49:42 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-94b6a292-f3c6-48a3-94c9-8f1ba5c4be40 req-60ba9d0c-bce0-4c9d-ac1b-41a8700cb6c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039911 Apr 11 15:49:42 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 293/884] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:49:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:49:44 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-842193a1-a083-4ccb-982c-cd6685252b9f req-beebd2e7-bab9-45a5-b500-39e168fcee46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0fc18ff-897c-4f97-95b6-9f25d11dba88", "name": "network-vif-plugged", "status": "completed", "tag": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:49:44 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-842193a1-a083-4ccb-982c-cd6685252b9f req-beebd2e7-bab9-45a5-b500-39e168fcee46 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:49:44 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-842193a1-a083-4ccb-982c-cd6685252b9f req-beebd2e7-bab9-45a5-b500-39e168fcee46 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:49:44 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-842193a1-a083-4ccb-982c-cd6685252b9f req-beebd2e7-bab9-45a5-b500-39e168fcee46 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:49:44 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-842193a1-a083-4ccb-982c-cd6685252b9f req-beebd2e7-bab9-45a5-b500-39e168fcee46 service nova] Creating event network-vif-plugged:cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 for instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 on user Apr 11 15:49:44 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-842193a1-a083-4ccb-982c-cd6685252b9f req-beebd2e7-bab9-45a5-b500-39e168fcee46 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031812 Apr 11 15:49:44 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 299/885] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:49:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:49:46 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-1cc89406-ce10-4e47-a3de-c0f4082baec8 req-c0285d1d-71ce-4cc1-8e80-035d0cca232f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0fc18ff-897c-4f97-95b6-9f25d11dba88", "name": "network-vif-plugged", "status": "completed", "tag": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:49:46 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-1cc89406-ce10-4e47-a3de-c0f4082baec8 req-c0285d1d-71ce-4cc1-8e80-035d0cca232f service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:49:46 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-1cc89406-ce10-4e47-a3de-c0f4082baec8 req-c0285d1d-71ce-4cc1-8e80-035d0cca232f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:49:46 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-1cc89406-ce10-4e47-a3de-c0f4082baec8 req-c0285d1d-71ce-4cc1-8e80-035d0cca232f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:49:46 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-1cc89406-ce10-4e47-a3de-c0f4082baec8 req-c0285d1d-71ce-4cc1-8e80-035d0cca232f service nova] Creating event network-vif-plugged:cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 for instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 on user Apr 11 15:49:46 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-1cc89406-ce10-4e47-a3de-c0f4082baec8 req-c0285d1d-71ce-4cc1-8e80-035d0cca232f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032131 Apr 11 15:49:46 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 294/886] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:49:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:49:48 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-ed3d13eb-496a-4149-b04d-62db0b68d20e req-98f741cd-e992-4838-ae9c-099789a719e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0fc18ff-897c-4f97-95b6-9f25d11dba88", "name": "network-vif-plugged", "status": "completed", "tag": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:49:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-ed3d13eb-496a-4149-b04d-62db0b68d20e req-98f741cd-e992-4838-ae9c-099789a719e0 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:49:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-ed3d13eb-496a-4149-b04d-62db0b68d20e req-98f741cd-e992-4838-ae9c-099789a719e0 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:49:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-ed3d13eb-496a-4149-b04d-62db0b68d20e req-98f741cd-e992-4838-ae9c-099789a719e0 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:49:48 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-ed3d13eb-496a-4149-b04d-62db0b68d20e req-98f741cd-e992-4838-ae9c-099789a719e0 service nova] Creating event network-vif-plugged:cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 for instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 on user Apr 11 15:49:48 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-ed3d13eb-496a-4149-b04d-62db0b68d20e req-98f741cd-e992-4838-ae9c-099789a719e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030549 Apr 11 15:49:48 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 294/887] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:49:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:49:59 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-10a9d413-4e90-496d-96c5-8afd44aeb88c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:49:59 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-10a9d413-4e90-496d-96c5-8afd44aeb88c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:49:59 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=8 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:49:59 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:49:59 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-10a9d413-4e90-496d-96c5-8afd44aeb88c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:49:59 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-10a9d413-4e90-496d-96c5-8afd44aeb88c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:49:59 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-10a9d413-4e90-496d-96c5-8afd44aeb88c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:49:59 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-10a9d413-4e90-496d-96c5-8afd44aeb88c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:49:59 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-10a9d413-4e90-496d-96c5-8afd44aeb88c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:49:59 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-10a9d413-4e90-496d-96c5-8afd44aeb88c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:50:00 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-10a9d413-4e90-496d-96c5-8afd44aeb88c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.116968 Apr 11 15:50:00 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 300/888] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 15:49:59 2023] GET /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/os-interface => generated 282 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:50:00 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:50:00 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:50:01 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-30306ff6-d4c4-4fb0-a168-32eba509868d req-5443cc14-b4bd-4925-b3cb-6dae97bdc734 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a", "tag": "35ac8f6f-2998-4274-ab63-df7086194703"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:50:01 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-30306ff6-d4c4-4fb0-a168-32eba509868d req-5443cc14-b4bd-4925-b3cb-6dae97bdc734 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:50:01 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-30306ff6-d4c4-4fb0-a168-32eba509868d req-5443cc14-b4bd-4925-b3cb-6dae97bdc734 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:50:01 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-30306ff6-d4c4-4fb0-a168-32eba509868d req-5443cc14-b4bd-4925-b3cb-6dae97bdc734 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:50:01 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-30306ff6-d4c4-4fb0-a168-32eba509868d req-5443cc14-b4bd-4925-b3cb-6dae97bdc734 service nova] Creating event network-changed:35ac8f6f-2998-4274-ab63-df7086194703 for instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a on user Apr 11 15:50:01 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-30306ff6-d4c4-4fb0-a168-32eba509868d req-5443cc14-b4bd-4925-b3cb-6dae97bdc734 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092647 Apr 11 15:50:01 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 295/889] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:50:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:50:01 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:50:01 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:50:01 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=10 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:50:01 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:50:01 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:50:01 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:50:01 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:50:01 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:50:01 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:50:01 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:50:01 user devstack@n-api.service[61166]: DEBUG nova.objects.instance [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'services' on Instance uuid c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a {{(pid=61166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 15:50:01 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/os-volume_attachments/a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3" status: 202 len: 0 microversion: 2.1 time: 0.172187 Apr 11 15:50:01 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 295/890] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 15:50:01 2023] DELETE /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/os-volume_attachments/a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:50:01 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-f392664f-9d67-46c5-8a7f-48192c739f5e tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:50:01 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-f392664f-9d67-46c5-8a7f-48192c739f5e tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:50:01 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f392664f-9d67-46c5-8a7f-48192c739f5e tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:50:01 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f392664f-9d67-46c5-8a7f-48192c739f5e tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:50:01 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f392664f-9d67-46c5-8a7f-48192c739f5e tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:50:01 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f392664f-9d67-46c5-8a7f-48192c739f5e tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:50:01 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f392664f-9d67-46c5-8a7f-48192c739f5e tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:50:01 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f392664f-9d67-46c5-8a7f-48192c739f5e tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:50:01 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-f392664f-9d67-46c5-8a7f-48192c739f5e tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052043 Apr 11 15:50:01 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 301/891] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:50:01 2023] GET /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:50:03 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-da131050-24c7-455a-b5d2-0d60a3f62d8d req-51cb630e-9857-4686-a046-c79414d91f69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a", "tag": "35ac8f6f-2998-4274-ab63-df7086194703"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:50:03 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-da131050-24c7-455a-b5d2-0d60a3f62d8d req-51cb630e-9857-4686-a046-c79414d91f69 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:50:03 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-da131050-24c7-455a-b5d2-0d60a3f62d8d req-51cb630e-9857-4686-a046-c79414d91f69 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:50:03 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-da131050-24c7-455a-b5d2-0d60a3f62d8d req-51cb630e-9857-4686-a046-c79414d91f69 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:50:03 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-da131050-24c7-455a-b5d2-0d60a3f62d8d req-51cb630e-9857-4686-a046-c79414d91f69 service nova] Creating event network-changed:35ac8f6f-2998-4274-ab63-df7086194703 for instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a on user Apr 11 15:50:03 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-da131050-24c7-455a-b5d2-0d60a3f62d8d req-51cb630e-9857-4686-a046-c79414d91f69 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033722 Apr 11 15:50:03 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 296/892] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:50:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:50:28 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:50:28 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:50:28 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-c7d8e223-b167-4f1d-840f-179237da9ef6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:50:28 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-c7d8e223-b167-4f1d-840f-179237da9ef6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:50:28 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c7d8e223-b167-4f1d-840f-179237da9ef6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:50:28 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c7d8e223-b167-4f1d-840f-179237da9ef6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:50:28 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c7d8e223-b167-4f1d-840f-179237da9ef6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:50:28 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c7d8e223-b167-4f1d-840f-179237da9ef6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:50:28 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c7d8e223-b167-4f1d-840f-179237da9ef6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:50:28 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c7d8e223-b167-4f1d-840f-179237da9ef6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:50:28 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-c7d8e223-b167-4f1d-840f-179237da9ef6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] HTTP exception thrown: Instance 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d could not be found. Apr 11 15:50:28 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-c7d8e223-b167-4f1d-840f-179237da9ef6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Request method failure captured: Apr 11 15:50:28 user devstack@n-api.service[61166]: request: GET /compute/v2.1/servers/07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d HTTP/1.1 Apr 11 15:50:28 user devstack@n-api.service[61166]: Accept: application/json Apr 11 15:50:28 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 15:50:28 user devstack@n-api.service[61166]: Connection: close Apr 11 15:50:28 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 15:50:28 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 15:50:28 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 15:50:28 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 15:50:28 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 15:50:28 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNX_MfySgeWQGetehYkoHqYg1G1945hTNCEJ0iZ6MzpnT3yZAJa_LjZxGoo77mYeoWNM22txPKHxqCAJQHMF1JaEqPSco0vUdydRE47pwKZna0AOIEDnSU3nak09PN7xX11kpifNQbUB7HIx3dygnGm9WJh4EQWIeaVGEcb-QhV49Vog Apr 11 15:50:28 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 15:50:28 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 15:50:28 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 15:50:28 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 15:50:28 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 15:50:28 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 15:50:28 user devstack@n-api.service[61166]: X-Project-Id: 312851c65ba1434691eca0cd2a8cd6d2 Apr 11 15:50:28 user devstack@n-api.service[61166]: X-Project-Name: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:50:28 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 15:50:28 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 15:50:28 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:50:28 user devstack@n-api.service[61166]: X-Tenant: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:50:28 user devstack@n-api.service[61166]: X-Tenant-Id: 312851c65ba1434691eca0cd2a8cd6d2 Apr 11 15:50:28 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:50:28 user devstack@n-api.service[61166]: X-User: tempest-TestVolumeBootPattern-1933582504-project-member Apr 11 15:50:28 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 15:50:28 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 15:50:28 user devstack@n-api.service[61166]: X-User-Id: c2110b74f38642afa560e1c9790d3f81 Apr 11 15:50:28 user devstack@n-api.service[61166]: X-User-Name: tempest-TestVolumeBootPattern-1933582504-project-member Apr 11 15:50:28 user devstack@n-api.service[61166]: method: > Apr 11 15:50:28 user devstack@n-api.service[61166]: exception: Instance 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d could not be found. Apr 11 15:50:28 user devstack@n-api.service[61166]: action_args: {'id': '07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d'} Apr 11 15:50:28 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d could not be found. Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d could not be found. Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d could not be found. Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:50:28 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-c7d8e223-b167-4f1d-840f-179237da9ef6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Returning 404 to user: Instance 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d could not be found. {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:50:28 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-c7d8e223-b167-4f1d-840f-179237da9ef6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d" status: 404 len: 111 microversion: 2.1 time: 0.034971 Apr 11 15:50:28 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 296/893] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:50:28 2023] GET /compute/v2.1/servers/07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:50:28 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-9164e8ec-4bff-4f5c-b4ab-92c5135ea5b6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:50:28 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-9164e8ec-4bff-4f5c-b4ab-92c5135ea5b6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:50:28 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=4 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:50:28 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=10 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:50:28 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-9164e8ec-4bff-4f5c-b4ab-92c5135ea5b6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:50:28 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-9164e8ec-4bff-4f5c-b4ab-92c5135ea5b6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:50:28 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-9164e8ec-4bff-4f5c-b4ab-92c5135ea5b6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:50:28 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-9164e8ec-4bff-4f5c-b4ab-92c5135ea5b6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:50:28 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-9164e8ec-4bff-4f5c-b4ab-92c5135ea5b6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:50:28 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-9164e8ec-4bff-4f5c-b4ab-92c5135ea5b6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:50:28 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-9164e8ec-4bff-4f5c-b4ab-92c5135ea5b6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] HTTP exception thrown: Instance f4f0b39a-e99b-4bc7-aecc-24d4f754e674 could not be found. Apr 11 15:50:28 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-9164e8ec-4bff-4f5c-b4ab-92c5135ea5b6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Request method failure captured: Apr 11 15:50:28 user devstack@n-api.service[61167]: request: DELETE /compute/v2.1/servers/f4f0b39a-e99b-4bc7-aecc-24d4f754e674 HTTP/1.1 Apr 11 15:50:28 user devstack@n-api.service[61167]: Accept: application/json Apr 11 15:50:28 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 15:50:28 user devstack@n-api.service[61167]: Connection: close Apr 11 15:50:28 user devstack@n-api.service[61167]: Content-Length: 0 Apr 11 15:50:28 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 15:50:28 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 15:50:28 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 15:50:28 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 15:50:28 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNX_MfySgeWQGetehYkoHqYg1G1945hTNCEJ0iZ6MzpnT3yZAJa_LjZxGoo77mYeoWNM22txPKHxqCAJQHMF1JaEqPSco0vUdydRE47pwKZna0AOIEDnSU3nak09PN7xX11kpifNQbUB7HIx3dygnGm9WJh4EQWIeaVGEcb-QhV49Vog Apr 11 15:50:28 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 15:50:28 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 15:50:28 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 15:50:28 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 15:50:28 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 15:50:28 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 15:50:28 user devstack@n-api.service[61167]: X-Project-Id: 312851c65ba1434691eca0cd2a8cd6d2 Apr 11 15:50:28 user devstack@n-api.service[61167]: X-Project-Name: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:50:28 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 15:50:28 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 15:50:28 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:50:28 user devstack@n-api.service[61167]: X-Tenant: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:50:28 user devstack@n-api.service[61167]: X-Tenant-Id: 312851c65ba1434691eca0cd2a8cd6d2 Apr 11 15:50:28 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:50:28 user devstack@n-api.service[61167]: X-User: tempest-TestVolumeBootPattern-1933582504-project-member Apr 11 15:50:28 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 15:50:28 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 15:50:28 user devstack@n-api.service[61167]: X-User-Id: c2110b74f38642afa560e1c9790d3f81 Apr 11 15:50:28 user devstack@n-api.service[61167]: X-User-Name: tempest-TestVolumeBootPattern-1933582504-project-member Apr 11 15:50:28 user devstack@n-api.service[61167]: method: > Apr 11 15:50:28 user devstack@n-api.service[61167]: exception: Instance f4f0b39a-e99b-4bc7-aecc-24d4f754e674 could not be found. Apr 11 15:50:28 user devstack@n-api.service[61167]: action_args: {'id': 'f4f0b39a-e99b-4bc7-aecc-24d4f754e674'} Apr 11 15:50:28 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4f0b39a-e99b-4bc7-aecc-24d4f754e674 could not be found. Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4f0b39a-e99b-4bc7-aecc-24d4f754e674 could not be found. Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4f0b39a-e99b-4bc7-aecc-24d4f754e674 could not be found. Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:50:28 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-9164e8ec-4bff-4f5c-b4ab-92c5135ea5b6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Returning 404 to user: Instance f4f0b39a-e99b-4bc7-aecc-24d4f754e674 could not be found. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:50:28 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-9164e8ec-4bff-4f5c-b4ab-92c5135ea5b6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f4f0b39a-e99b-4bc7-aecc-24d4f754e674" status: 404 len: 111 microversion: 2.1 time: 0.033641 Apr 11 15:50:28 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 302/894] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:50:28 2023] DELETE /compute/v2.1/servers/f4f0b39a-e99b-4bc7-aecc-24d4f754e674 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:50:28 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-23f1614f-03dc-4423-b425-aa68ddd14274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:50:28 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-23f1614f-03dc-4423-b425-aa68ddd14274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:50:28 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:50:28 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:50:28 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-23f1614f-03dc-4423-b425-aa68ddd14274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:50:28 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-23f1614f-03dc-4423-b425-aa68ddd14274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:50:28 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-23f1614f-03dc-4423-b425-aa68ddd14274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:50:28 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-23f1614f-03dc-4423-b425-aa68ddd14274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:50:28 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-23f1614f-03dc-4423-b425-aa68ddd14274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:50:28 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-23f1614f-03dc-4423-b425-aa68ddd14274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:50:28 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-23f1614f-03dc-4423-b425-aa68ddd14274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] HTTP exception thrown: Instance f4f0b39a-e99b-4bc7-aecc-24d4f754e674 could not be found. Apr 11 15:50:28 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-23f1614f-03dc-4423-b425-aa68ddd14274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Request method failure captured: Apr 11 15:50:28 user devstack@n-api.service[61165]: request: GET /compute/v2.1/servers/f4f0b39a-e99b-4bc7-aecc-24d4f754e674 HTTP/1.1 Apr 11 15:50:28 user devstack@n-api.service[61165]: Accept: application/json Apr 11 15:50:28 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 15:50:28 user devstack@n-api.service[61165]: Connection: close Apr 11 15:50:28 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 15:50:28 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 15:50:28 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 15:50:28 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 15:50:28 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 15:50:28 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNX_MfySgeWQGetehYkoHqYg1G1945hTNCEJ0iZ6MzpnT3yZAJa_LjZxGoo77mYeoWNM22txPKHxqCAJQHMF1JaEqPSco0vUdydRE47pwKZna0AOIEDnSU3nak09PN7xX11kpifNQbUB7HIx3dygnGm9WJh4EQWIeaVGEcb-QhV49Vog Apr 11 15:50:28 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 15:50:28 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 15:50:28 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 15:50:28 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 15:50:28 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 15:50:28 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 15:50:28 user devstack@n-api.service[61165]: X-Project-Id: 312851c65ba1434691eca0cd2a8cd6d2 Apr 11 15:50:28 user devstack@n-api.service[61165]: X-Project-Name: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:50:28 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 15:50:28 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 15:50:28 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:50:28 user devstack@n-api.service[61165]: X-Tenant: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:50:28 user devstack@n-api.service[61165]: X-Tenant-Id: 312851c65ba1434691eca0cd2a8cd6d2 Apr 11 15:50:28 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:50:28 user devstack@n-api.service[61165]: X-User: tempest-TestVolumeBootPattern-1933582504-project-member Apr 11 15:50:28 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 15:50:28 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 15:50:28 user devstack@n-api.service[61165]: X-User-Id: c2110b74f38642afa560e1c9790d3f81 Apr 11 15:50:28 user devstack@n-api.service[61165]: X-User-Name: tempest-TestVolumeBootPattern-1933582504-project-member Apr 11 15:50:28 user devstack@n-api.service[61165]: method: > Apr 11 15:50:28 user devstack@n-api.service[61165]: exception: Instance f4f0b39a-e99b-4bc7-aecc-24d4f754e674 could not be found. Apr 11 15:50:28 user devstack@n-api.service[61165]: action_args: {'id': 'f4f0b39a-e99b-4bc7-aecc-24d4f754e674'} Apr 11 15:50:28 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4f0b39a-e99b-4bc7-aecc-24d4f754e674 could not be found. Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4f0b39a-e99b-4bc7-aecc-24d4f754e674 could not be found. Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4f0b39a-e99b-4bc7-aecc-24d4f754e674 could not be found. Apr 11 15:50:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:50:28 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-23f1614f-03dc-4423-b425-aa68ddd14274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Returning 404 to user: Instance f4f0b39a-e99b-4bc7-aecc-24d4f754e674 could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:50:28 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-23f1614f-03dc-4423-b425-aa68ddd14274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f4f0b39a-e99b-4bc7-aecc-24d4f754e674" status: 404 len: 111 microversion: 2.1 time: 0.037018 Apr 11 15:50:28 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 297/895] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:50:28 2023] GET /compute/v2.1/servers/f4f0b39a-e99b-4bc7-aecc-24d4f754e674 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:50:28 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-deaaa953-d0b3-4ef4-b61b-4d22737546b5 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:50:28 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-deaaa953-d0b3-4ef4-b61b-4d22737546b5 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:50:28 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-deaaa953-d0b3-4ef4-b61b-4d22737546b5 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:50:28 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-deaaa953-d0b3-4ef4-b61b-4d22737546b5 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:50:28 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-deaaa953-d0b3-4ef4-b61b-4d22737546b5 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:50:28 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-deaaa953-d0b3-4ef4-b61b-4d22737546b5 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:50:28 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-deaaa953-d0b3-4ef4-b61b-4d22737546b5 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:50:28 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-deaaa953-d0b3-4ef4-b61b-4d22737546b5 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:50:28 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-deaaa953-d0b3-4ef4-b61b-4d22737546b5 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] HTTP exception thrown: Instance 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d could not be found. Apr 11 15:50:28 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-deaaa953-d0b3-4ef4-b61b-4d22737546b5 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Request method failure captured: Apr 11 15:50:28 user devstack@n-api.service[61166]: request: DELETE /compute/v2.1/servers/07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d HTTP/1.1 Apr 11 15:50:28 user devstack@n-api.service[61166]: Accept: application/json Apr 11 15:50:28 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 15:50:28 user devstack@n-api.service[61166]: Connection: close Apr 11 15:50:28 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 15:50:28 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 15:50:28 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 15:50:28 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 15:50:28 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 15:50:28 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNX_MfySgeWQGetehYkoHqYg1G1945hTNCEJ0iZ6MzpnT3yZAJa_LjZxGoo77mYeoWNM22txPKHxqCAJQHMF1JaEqPSco0vUdydRE47pwKZna0AOIEDnSU3nak09PN7xX11kpifNQbUB7HIx3dygnGm9WJh4EQWIeaVGEcb-QhV49Vog Apr 11 15:50:28 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 15:50:28 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 15:50:28 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 15:50:28 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 15:50:28 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 15:50:28 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 15:50:28 user devstack@n-api.service[61166]: X-Project-Id: 312851c65ba1434691eca0cd2a8cd6d2 Apr 11 15:50:28 user devstack@n-api.service[61166]: X-Project-Name: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:50:28 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 15:50:28 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 15:50:28 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:50:28 user devstack@n-api.service[61166]: X-Tenant: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:50:28 user devstack@n-api.service[61166]: X-Tenant-Id: 312851c65ba1434691eca0cd2a8cd6d2 Apr 11 15:50:28 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:50:28 user devstack@n-api.service[61166]: X-User: tempest-TestVolumeBootPattern-1933582504-project-member Apr 11 15:50:28 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 15:50:28 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 15:50:28 user devstack@n-api.service[61166]: X-User-Id: c2110b74f38642afa560e1c9790d3f81 Apr 11 15:50:28 user devstack@n-api.service[61166]: X-User-Name: tempest-TestVolumeBootPattern-1933582504-project-member Apr 11 15:50:28 user devstack@n-api.service[61166]: method: > Apr 11 15:50:28 user devstack@n-api.service[61166]: exception: Instance 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d could not be found. Apr 11 15:50:28 user devstack@n-api.service[61166]: action_args: {'id': '07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d'} Apr 11 15:50:28 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d could not be found. Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d could not be found. Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d could not be found. Apr 11 15:50:28 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:50:28 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-deaaa953-d0b3-4ef4-b61b-4d22737546b5 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Returning 404 to user: Instance 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d could not be found. {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:50:28 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-deaaa953-d0b3-4ef4-b61b-4d22737546b5 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d" status: 404 len: 111 microversion: 2.1 time: 0.049460 Apr 11 15:50:28 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 297/896] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:50:28 2023] DELETE /compute/v2.1/servers/07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:50:28 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-c05ca8b6-cfa3-4786-929b-40f3d4f6ae66 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:50:28 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-c05ca8b6-cfa3-4786-929b-40f3d4f6ae66 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:50:28 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c05ca8b6-cfa3-4786-929b-40f3d4f6ae66 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:50:28 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c05ca8b6-cfa3-4786-929b-40f3d4f6ae66 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:50:28 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c05ca8b6-cfa3-4786-929b-40f3d4f6ae66 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:50:28 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c05ca8b6-cfa3-4786-929b-40f3d4f6ae66 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:50:28 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c05ca8b6-cfa3-4786-929b-40f3d4f6ae66 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:50:28 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c05ca8b6-cfa3-4786-929b-40f3d4f6ae66 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:50:28 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-c05ca8b6-cfa3-4786-929b-40f3d4f6ae66 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] HTTP exception thrown: Instance 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d could not be found. Apr 11 15:50:28 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-c05ca8b6-cfa3-4786-929b-40f3d4f6ae66 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Request method failure captured: Apr 11 15:50:28 user devstack@n-api.service[61167]: request: GET /compute/v2.1/servers/07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d HTTP/1.1 Apr 11 15:50:28 user devstack@n-api.service[61167]: Accept: application/json Apr 11 15:50:28 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 15:50:28 user devstack@n-api.service[61167]: Connection: close Apr 11 15:50:28 user devstack@n-api.service[61167]: Content-Length: 0 Apr 11 15:50:28 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 15:50:28 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 15:50:28 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 15:50:28 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 15:50:28 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNX_MfySgeWQGetehYkoHqYg1G1945hTNCEJ0iZ6MzpnT3yZAJa_LjZxGoo77mYeoWNM22txPKHxqCAJQHMF1JaEqPSco0vUdydRE47pwKZna0AOIEDnSU3nak09PN7xX11kpifNQbUB7HIx3dygnGm9WJh4EQWIeaVGEcb-QhV49Vog Apr 11 15:50:28 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 15:50:28 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 15:50:28 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 15:50:28 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 15:50:28 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 15:50:28 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 15:50:28 user devstack@n-api.service[61167]: X-Project-Id: 312851c65ba1434691eca0cd2a8cd6d2 Apr 11 15:50:28 user devstack@n-api.service[61167]: X-Project-Name: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:50:28 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 15:50:28 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 15:50:28 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:50:28 user devstack@n-api.service[61167]: X-Tenant: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:50:28 user devstack@n-api.service[61167]: X-Tenant-Id: 312851c65ba1434691eca0cd2a8cd6d2 Apr 11 15:50:28 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:50:28 user devstack@n-api.service[61167]: X-User: tempest-TestVolumeBootPattern-1933582504-project-member Apr 11 15:50:28 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 15:50:28 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 15:50:28 user devstack@n-api.service[61167]: X-User-Id: c2110b74f38642afa560e1c9790d3f81 Apr 11 15:50:28 user devstack@n-api.service[61167]: X-User-Name: tempest-TestVolumeBootPattern-1933582504-project-member Apr 11 15:50:28 user devstack@n-api.service[61167]: method: > Apr 11 15:50:28 user devstack@n-api.service[61167]: exception: Instance 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d could not be found. Apr 11 15:50:28 user devstack@n-api.service[61167]: action_args: {'id': '07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d'} Apr 11 15:50:28 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d could not be found. Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d could not be found. Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d could not be found. Apr 11 15:50:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:50:28 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-c05ca8b6-cfa3-4786-929b-40f3d4f6ae66 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Returning 404 to user: Instance 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d could not be found. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:50:28 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-c05ca8b6-cfa3-4786-929b-40f3d4f6ae66 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d" status: 404 len: 111 microversion: 2.1 time: 0.028145 Apr 11 15:50:28 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 303/897] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:50:28 2023] GET /compute/v2.1/servers/07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:50:28 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-4afab1f0-8cbe-4ee1-8a3d-33e28f897b56 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Action: 'create', calling method: .version_select at 0x7f4c2ecabf40>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1289860889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHFmBexXT+1iiEvWvrTBCCfLTFSZaBECTRUjU2HFOZ99DTdS224XqNm6W0NLu+fhNbtUG4d3cptal0K2Oy5ZbjfRTK7G/g++ylfyvf1YI+eSa1yX5tyMrdSO5dom9On9A=="}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:50:28 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-4afab1f0-8cbe-4ee1-8a3d-33e28f897b56 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Getting quotas for project 312851c65ba1434691eca0cd2a8cd6d2. Resources: {'key_pairs'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:50:28 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-4afab1f0-8cbe-4ee1-8a3d-33e28f897b56 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Getting quotas for user c2110b74f38642afa560e1c9790d3f81 and project 312851c65ba1434691eca0cd2a8cd6d2. Resources: {'key_pairs'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:50:28 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-4afab1f0-8cbe-4ee1-8a3d-33e28f897b56 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.047377 Apr 11 15:50:28 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 298/898] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 15:50:28 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:50:31 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-a6bd84e6-f3cc-4f81-a900-45f32dd3790a tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:50:31 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-a6bd84e6-f3cc-4f81-a900-45f32dd3790a tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:50:31 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-a6bd84e6-f3cc-4f81-a900-45f32dd3790a tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:50:31 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-a6bd84e6-f3cc-4f81-a900-45f32dd3790a tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:50:31 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-a6bd84e6-f3cc-4f81-a900-45f32dd3790a tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:50:31 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-a6bd84e6-f3cc-4f81-a900-45f32dd3790a tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:50:31 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-a6bd84e6-f3cc-4f81-a900-45f32dd3790a tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:50:31 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-a6bd84e6-f3cc-4f81-a900-45f32dd3790a tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:50:31 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1640081057", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1289860889", "security_groups": [{"name": "tempest-secgroup-smoke-579571176"}], "block_device_mapping_v2": [{"uuid": "8e80be1f-47e3-4658-bdfe-610ca8e958a0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24"}]}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:50:31 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-a6bd84e6-f3cc-4f81-a900-45f32dd3790a tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b244004380d43699c5a06e817224b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c9dbdbc7b641f096dc292ea7bf7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:50:31 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-a6bd84e6-f3cc-4f81-a900-45f32dd3790a tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88" status: 200 len: 1704 microversion: 2.1 time: 0.174775 Apr 11 15:50:31 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 298/899] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:50:31 2023] GET /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88 => generated 1704 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:50:31 user devstack@n-api.service[61167]: DEBUG nova.network.neutron [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] validate_networks() for [('8d262ba8-b9c3-44ed-8431-6c295eb9ea24', None, None, None, None, None)] {{(pid=61167) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:50:32 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Flavor limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:50:32 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Image limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:50:32 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Flavor pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:50:32 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Image pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:50:32 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:50:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:50:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:50:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:50:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:50:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:50:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:50:32 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Getting quotas for project 312851c65ba1434691eca0cd2a8cd6d2. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:50:32 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Getting quotas for user c2110b74f38642afa560e1c9790d3f81 and project 312851c65ba1434691eca0cd2a8cd6d2. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:50:32 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Going to run 1 instances... {{(pid=61167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:50:32 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8e80be1f-47e3-4658-bdfe-610ca8e958a0',volume_size=None,volume_type=None)] {{(pid=61167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:50:32 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.822230 Apr 11 15:50:32 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 304/900] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 15:50:31 2023] POST /compute/v2.1/servers => generated 403 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 15:50:32 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-3d58e69d-76ba-4194-b8a2-7bb5e4ef9d72 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:50:32 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-3d58e69d-76ba-4194-b8a2-7bb5e4ef9d72 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:50:32 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-3d58e69d-76ba-4194-b8a2-7bb5e4ef9d72 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2110b74f38642afa560e1c9790d3f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312851c65ba1434691eca0cd2a8cd6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:50:32 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-3d58e69d-76ba-4194-b8a2-7bb5e4ef9d72 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/507b2cc1-0a6c-4ae2-a254-3a991f495fe3" status: 200 len: 1090 microversion: 2.1 time: 0.068025 Apr 11 15:50:32 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 299/901] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:50:32 2023] GET /compute/v2.1/servers/507b2cc1-0a6c-4ae2-a254-3a991f495fe3 => generated 1090 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:50:34 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-3be2c4b1-e809-478b-8049-cf26e2fe1488 req-9d10919d-7739-4581-962a-c163df8e415e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "507b2cc1-0a6c-4ae2-a254-3a991f495fe3", "tag": "ffa45d48-79f2-4055-bb7c-33172e34fb8b"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:50:34 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-3be2c4b1-e809-478b-8049-cf26e2fe1488 req-9d10919d-7739-4581-962a-c163df8e415e service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:50:34 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-3be2c4b1-e809-478b-8049-cf26e2fe1488 req-9d10919d-7739-4581-962a-c163df8e415e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:50:34 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-3be2c4b1-e809-478b-8049-cf26e2fe1488 req-9d10919d-7739-4581-962a-c163df8e415e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:50:34 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-3be2c4b1-e809-478b-8049-cf26e2fe1488 req-9d10919d-7739-4581-962a-c163df8e415e service nova] Creating event network-changed:ffa45d48-79f2-4055-bb7c-33172e34fb8b for instance 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 on user Apr 11 15:50:34 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-3be2c4b1-e809-478b-8049-cf26e2fe1488 req-9d10919d-7739-4581-962a-c163df8e415e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032411 Apr 11 15:50:34 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 299/902] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:50:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:50:40 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-bfb5d7db-9dda-4c29-bcad-1e3fcc064146 req-da3868cb-e107-4083-90c1-4b225d85d9f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "507b2cc1-0a6c-4ae2-a254-3a991f495fe3", "name": "network-vif-plugged", "status": "completed", "tag": "ffa45d48-79f2-4055-bb7c-33172e34fb8b"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:50:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-bfb5d7db-9dda-4c29-bcad-1e3fcc064146 req-da3868cb-e107-4083-90c1-4b225d85d9f6 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:50:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-bfb5d7db-9dda-4c29-bcad-1e3fcc064146 req-da3868cb-e107-4083-90c1-4b225d85d9f6 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:50:40 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-bfb5d7db-9dda-4c29-bcad-1e3fcc064146 req-da3868cb-e107-4083-90c1-4b225d85d9f6 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:50:40 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-bfb5d7db-9dda-4c29-bcad-1e3fcc064146 req-da3868cb-e107-4083-90c1-4b225d85d9f6 service nova] Creating event network-vif-plugged:ffa45d48-79f2-4055-bb7c-33172e34fb8b for instance 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 on user Apr 11 15:50:40 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-bfb5d7db-9dda-4c29-bcad-1e3fcc064146 req-da3868cb-e107-4083-90c1-4b225d85d9f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030651 Apr 11 15:50:40 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 305/903] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:50:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:50:42 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-2a2540d1-f95f-4726-8978-85e2f130dc07 req-ffa57237-5a2a-44f5-899b-86048f1c5c89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "507b2cc1-0a6c-4ae2-a254-3a991f495fe3", "name": "network-vif-plugged", "status": "completed", "tag": "ffa45d48-79f2-4055-bb7c-33172e34fb8b"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:50:42 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:50:42 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:50:42 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:50:42 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-2a2540d1-f95f-4726-8978-85e2f130dc07 req-ffa57237-5a2a-44f5-899b-86048f1c5c89 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:50:42 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-2a2540d1-f95f-4726-8978-85e2f130dc07 req-ffa57237-5a2a-44f5-899b-86048f1c5c89 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:50:42 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-2a2540d1-f95f-4726-8978-85e2f130dc07 req-ffa57237-5a2a-44f5-899b-86048f1c5c89 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:50:42 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-2a2540d1-f95f-4726-8978-85e2f130dc07 req-ffa57237-5a2a-44f5-899b-86048f1c5c89 service nova] Creating event network-vif-plugged:ffa45d48-79f2-4055-bb7c-33172e34fb8b for instance 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 on user Apr 11 15:50:42 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-2a2540d1-f95f-4726-8978-85e2f130dc07 req-ffa57237-5a2a-44f5-899b-86048f1c5c89 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038404 Apr 11 15:50:42 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 300/904] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:50:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:50:51 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=8 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:50:51 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=12 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:50:51 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-c753b81d-7b5f-4f6a-a77a-c125079435b9 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:50:51 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-c753b81d-7b5f-4f6a-a77a-c125079435b9 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:50:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c753b81d-7b5f-4f6a-a77a-c125079435b9 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:50:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c753b81d-7b5f-4f6a-a77a-c125079435b9 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:50:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c753b81d-7b5f-4f6a-a77a-c125079435b9 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:50:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c753b81d-7b5f-4f6a-a77a-c125079435b9 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:50:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c753b81d-7b5f-4f6a-a77a-c125079435b9 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:50:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c753b81d-7b5f-4f6a-a77a-c125079435b9 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:50:51 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-c753b81d-7b5f-4f6a-a77a-c125079435b9 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058560 Apr 11 15:50:51 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 300/905] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:50:51 2023] GET /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 15:50:51 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:50:51 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:50:51 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:50:51 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=8 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:50:51 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:50:51 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:50:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:50:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:50:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:50:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:50:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:50:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:50:51 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Going to try to terminate instance {{(pid=61167) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:50:51 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" status: 204 len: 0 microversion: 2.1 time: 0.120921 Apr 11 15:50:51 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 306/906] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:50:51 2023] DELETE /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:50:51 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-17eced58-bbb7-4423-b173-6622725c1ccf tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:50:51 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-17eced58-bbb7-4423-b173-6622725c1ccf tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:50:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-17eced58-bbb7-4423-b173-6622725c1ccf tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:50:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-17eced58-bbb7-4423-b173-6622725c1ccf tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:50:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-17eced58-bbb7-4423-b173-6622725c1ccf tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:50:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-17eced58-bbb7-4423-b173-6622725c1ccf tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:50:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-17eced58-bbb7-4423-b173-6622725c1ccf tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:50:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-17eced58-bbb7-4423-b173-6622725c1ccf tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:50:51 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-17eced58-bbb7-4423-b173-6622725c1ccf tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8492f96e5d4f54aaae3679c82b6759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd700a53aa25849e0afd562b05881d09a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:50:51 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-17eced58-bbb7-4423-b173-6622725c1ccf tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" status: 200 len: 1678 microversion: 2.1 time: 0.181146 Apr 11 15:50:51 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 301/907] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:50:51 2023] GET /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a => generated 1678 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:50:51 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-f5c7e041-f514-4113-9d81-584f763353e6 req-2ee842d1-3293-434d-abe3-ec14fba1c10e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a", "name": "network-vif-unplugged", "status": "completed", "tag": "35ac8f6f-2998-4274-ab63-df7086194703"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:50:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-f5c7e041-f514-4113-9d81-584f763353e6 req-2ee842d1-3293-434d-abe3-ec14fba1c10e service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:50:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-f5c7e041-f514-4113-9d81-584f763353e6 req-2ee842d1-3293-434d-abe3-ec14fba1c10e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:50:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-f5c7e041-f514-4113-9d81-584f763353e6 req-2ee842d1-3293-434d-abe3-ec14fba1c10e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:50:51 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-f5c7e041-f514-4113-9d81-584f763353e6 req-2ee842d1-3293-434d-abe3-ec14fba1c10e service nova] Creating event network-vif-unplugged:35ac8f6f-2998-4274-ab63-df7086194703 for instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a on user Apr 11 15:50:51 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-f5c7e041-f514-4113-9d81-584f763353e6 req-2ee842d1-3293-434d-abe3-ec14fba1c10e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034986 Apr 11 15:50:51 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 301/908] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:50:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:50:53 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-8e77c1c1-65bb-4146-a203-6f603a58d060 req-60e1a26c-5339-4c83-8fa8-0d90e93d92a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a", "name": "network-vif-deleted", "tag": "35ac8f6f-2998-4274-ab63-df7086194703"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:50:53 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-8e77c1c1-65bb-4146-a203-6f603a58d060 req-60e1a26c-5339-4c83-8fa8-0d90e93d92a4 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:50:53 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-8e77c1c1-65bb-4146-a203-6f603a58d060 req-60e1a26c-5339-4c83-8fa8-0d90e93d92a4 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:50:53 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-8e77c1c1-65bb-4146-a203-6f603a58d060 req-60e1a26c-5339-4c83-8fa8-0d90e93d92a4 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:50:53 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-8e77c1c1-65bb-4146-a203-6f603a58d060 req-60e1a26c-5339-4c83-8fa8-0d90e93d92a4 service nova] Creating event network-vif-deleted:35ac8f6f-2998-4274-ab63-df7086194703 for instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a on user Apr 11 15:50:53 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-8e77c1c1-65bb-4146-a203-6f603a58d060 req-60e1a26c-5339-4c83-8fa8-0d90e93d92a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032451 Apr 11 15:50:53 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 307/909] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:50:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:50:54 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-8bd98c50-71b5-4c86-b781-28a87b719cf9 req-f72905a2-2027-4a2d-86c7-5fd31446607a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a", "name": "network-vif-plugged", "status": "completed", "tag": "35ac8f6f-2998-4274-ab63-df7086194703"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:50:54 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-8bd98c50-71b5-4c86-b781-28a87b719cf9 req-f72905a2-2027-4a2d-86c7-5fd31446607a service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:50:54 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-8bd98c50-71b5-4c86-b781-28a87b719cf9 req-f72905a2-2027-4a2d-86c7-5fd31446607a service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:50:54 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-8bd98c50-71b5-4c86-b781-28a87b719cf9 req-f72905a2-2027-4a2d-86c7-5fd31446607a service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:50:54 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-8bd98c50-71b5-4c86-b781-28a87b719cf9 req-f72905a2-2027-4a2d-86c7-5fd31446607a service nova] Creating event network-vif-plugged:35ac8f6f-2998-4274-ab63-df7086194703 for instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a on user Apr 11 15:50:54 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-8bd98c50-71b5-4c86-b781-28a87b719cf9 req-f72905a2-2027-4a2d-86c7-5fd31446607a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029170 Apr 11 15:50:54 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 302/910] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:50:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:51:22 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:51:22 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=8 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:51:22 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-2de52435-cb79-46a5-a3fd-82c3952df3c4 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:51:22 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-2de52435-cb79-46a5-a3fd-82c3952df3c4 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:51:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-2de52435-cb79-46a5-a3fd-82c3952df3c4 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:51:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-2de52435-cb79-46a5-a3fd-82c3952df3c4 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:51:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-2de52435-cb79-46a5-a3fd-82c3952df3c4 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:51:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-2de52435-cb79-46a5-a3fd-82c3952df3c4 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:51:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-2de52435-cb79-46a5-a3fd-82c3952df3c4 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:51:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-2de52435-cb79-46a5-a3fd-82c3952df3c4 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:51:22 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-2de52435-cb79-46a5-a3fd-82c3952df3c4 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2110b74f38642afa560e1c9790d3f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312851c65ba1434691eca0cd2a8cd6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:51:22 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-2de52435-cb79-46a5-a3fd-82c3952df3c4 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/507b2cc1-0a6c-4ae2-a254-3a991f495fe3" status: 200 len: 1443 microversion: 2.1 time: 0.173863 Apr 11 15:51:22 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 302/911] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:51:22 2023] GET /compute/v2.1/servers/507b2cc1-0a6c-4ae2-a254-3a991f495fe3 => generated 1443 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:51:31 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:51:31 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:51:32 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-46312f2f-47b1-4c61-91d4-6b109b93b558 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:51:32 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-46312f2f-47b1-4c61-91d4-6b109b93b558 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:51:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-46312f2f-47b1-4c61-91d4-6b109b93b558 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:51:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-46312f2f-47b1-4c61-91d4-6b109b93b558 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:51:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-46312f2f-47b1-4c61-91d4-6b109b93b558 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:51:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-46312f2f-47b1-4c61-91d4-6b109b93b558 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:51:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-46312f2f-47b1-4c61-91d4-6b109b93b558 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:51:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-46312f2f-47b1-4c61-91d4-6b109b93b558 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:51:32 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-46312f2f-47b1-4c61-91d4-6b109b93b558 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88/action" status: 202 len: 0 microversion: 2.1 time: 0.233786 Apr 11 15:51:32 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 308/912] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 15:51:31 2023] POST /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:51:32 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:51:32 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=10 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:51:32 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-ba318532-612f-4c40-9375-7c5e8027e771 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:51:32 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-ba318532-612f-4c40-9375-7c5e8027e771 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:51:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ba318532-612f-4c40-9375-7c5e8027e771 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:51:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ba318532-612f-4c40-9375-7c5e8027e771 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:51:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ba318532-612f-4c40-9375-7c5e8027e771 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:51:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ba318532-612f-4c40-9375-7c5e8027e771 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:51:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ba318532-612f-4c40-9375-7c5e8027e771 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:51:32 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ba318532-612f-4c40-9375-7c5e8027e771 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:51:32 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-ba318532-612f-4c40-9375-7c5e8027e771 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.093201 Apr 11 15:51:32 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 303/913] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 15:51:32 2023] GET /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88/os-interface => generated 283 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:51:33 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-634133a4-e715-418a-8e00-b7b7e8b179ba req-baeca020-196e-4306-8fbb-a12dcbf1e8e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0fc18ff-897c-4f97-95b6-9f25d11dba88", "tag": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01"}, {"server_uuid": "f0fc18ff-897c-4f97-95b6-9f25d11dba88", "name": "network-vif-unplugged", "status": "completed", "tag": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:51:33 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:51:33 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:51:33 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-634133a4-e715-418a-8e00-b7b7e8b179ba req-baeca020-196e-4306-8fbb-a12dcbf1e8e0 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:51:33 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-634133a4-e715-418a-8e00-b7b7e8b179ba req-baeca020-196e-4306-8fbb-a12dcbf1e8e0 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:51:33 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-634133a4-e715-418a-8e00-b7b7e8b179ba req-baeca020-196e-4306-8fbb-a12dcbf1e8e0 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:51:33 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-634133a4-e715-418a-8e00-b7b7e8b179ba req-baeca020-196e-4306-8fbb-a12dcbf1e8e0 service nova] Creating event network-changed:cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 for instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 on user Apr 11 15:51:33 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-634133a4-e715-418a-8e00-b7b7e8b179ba req-baeca020-196e-4306-8fbb-a12dcbf1e8e0 service nova] Creating event network-vif-unplugged:cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 for instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 on user Apr 11 15:51:33 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-634133a4-e715-418a-8e00-b7b7e8b179ba req-baeca020-196e-4306-8fbb-a12dcbf1e8e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.035127 Apr 11 15:51:33 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 303/914] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:51:33 2023] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:51:35 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-75c038ee-21ef-4cc7-92bf-69d32d1d2562 req-b2b23dee-6eff-4a8b-87fc-fc3d76682b78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0fc18ff-897c-4f97-95b6-9f25d11dba88", "tag": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01"}, {"server_uuid": "f0fc18ff-897c-4f97-95b6-9f25d11dba88", "name": "network-vif-plugged", "status": "completed", "tag": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01"}, {"server_uuid": "f0fc18ff-897c-4f97-95b6-9f25d11dba88", "name": "network-vif-plugged", "status": "completed", "tag": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:51:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-75c038ee-21ef-4cc7-92bf-69d32d1d2562 req-b2b23dee-6eff-4a8b-87fc-fc3d76682b78 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:51:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-75c038ee-21ef-4cc7-92bf-69d32d1d2562 req-b2b23dee-6eff-4a8b-87fc-fc3d76682b78 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:51:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-75c038ee-21ef-4cc7-92bf-69d32d1d2562 req-b2b23dee-6eff-4a8b-87fc-fc3d76682b78 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:51:35 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-75c038ee-21ef-4cc7-92bf-69d32d1d2562 req-b2b23dee-6eff-4a8b-87fc-fc3d76682b78 service nova] Creating event network-changed:cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 for instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 on user Apr 11 15:51:35 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-75c038ee-21ef-4cc7-92bf-69d32d1d2562 req-b2b23dee-6eff-4a8b-87fc-fc3d76682b78 service nova] Creating event network-vif-plugged:cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 for instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 on user Apr 11 15:51:35 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-75c038ee-21ef-4cc7-92bf-69d32d1d2562 req-b2b23dee-6eff-4a8b-87fc-fc3d76682b78 service nova] Creating event network-vif-plugged:cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 for instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 on user Apr 11 15:51:35 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-75c038ee-21ef-4cc7-92bf-69d32d1d2562 req-b2b23dee-6eff-4a8b-87fc-fc3d76682b78 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.036749 Apr 11 15:51:35 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 309/915] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:51:35 2023] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:51:37 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-4084a7c2-ac52-49c9-b7f8-f14edcb3d321 req-d62ef2e9-e2a0-4ce8-af28-65633e48939b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0fc18ff-897c-4f97-95b6-9f25d11dba88", "name": "network-vif-plugged", "status": "completed", "tag": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:51:37 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-4084a7c2-ac52-49c9-b7f8-f14edcb3d321 req-d62ef2e9-e2a0-4ce8-af28-65633e48939b service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:51:37 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-4084a7c2-ac52-49c9-b7f8-f14edcb3d321 req-d62ef2e9-e2a0-4ce8-af28-65633e48939b service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:51:37 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-4084a7c2-ac52-49c9-b7f8-f14edcb3d321 req-d62ef2e9-e2a0-4ce8-af28-65633e48939b service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:51:37 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-4084a7c2-ac52-49c9-b7f8-f14edcb3d321 req-d62ef2e9-e2a0-4ce8-af28-65633e48939b service nova] Creating event network-vif-plugged:cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 for instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 on user Apr 11 15:51:37 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-4084a7c2-ac52-49c9-b7f8-f14edcb3d321 req-d62ef2e9-e2a0-4ce8-af28-65633e48939b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031099 Apr 11 15:51:37 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 304/916] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:51:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:51:41 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-1b7bdcc4-662b-4ded-860e-f85f324ee97d tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:51:41 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-1b7bdcc4-662b-4ded-860e-f85f324ee97d tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:51:41 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1b7bdcc4-662b-4ded-860e-f85f324ee97d tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:51:41 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1b7bdcc4-662b-4ded-860e-f85f324ee97d tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:51:41 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1b7bdcc4-662b-4ded-860e-f85f324ee97d tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:51:41 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1b7bdcc4-662b-4ded-860e-f85f324ee97d tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:51:41 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1b7bdcc4-662b-4ded-860e-f85f324ee97d tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:51:41 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1b7bdcc4-662b-4ded-860e-f85f324ee97d tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:51:42 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-1b7bdcc4-662b-4ded-860e-f85f324ee97d tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] HTTP exception thrown: Instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a could not be found. Apr 11 15:51:42 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-1b7bdcc4-662b-4ded-860e-f85f324ee97d tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Request method failure captured: Apr 11 15:51:42 user devstack@n-api.service[61166]: request: GET /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a HTTP/1.1 Apr 11 15:51:42 user devstack@n-api.service[61166]: Accept: application/json Apr 11 15:51:42 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 15:51:42 user devstack@n-api.service[61166]: Connection: close Apr 11 15:51:42 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 15:51:42 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 15:51:42 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 15:51:42 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 15:51:42 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 15:51:42 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNX5Xpp64UjUCTvokQPchz3Z_zzZld6Gzzdi5g5f3dAzZMYNbfpuD5SVzUtCVXDSbv-6uA4tdlV5bq4l7Mfh7qU6Z3TnkgMq20ehg7ZRY4FWJXSHNtB12atJ6Is1L1bASyUvXy3UohCr63-e-VGzFJVGpcxBwakeRjEJokogPDcce5GQ Apr 11 15:51:42 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 15:51:42 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 15:51:42 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 15:51:42 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 15:51:42 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 15:51:42 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 15:51:42 user devstack@n-api.service[61166]: X-Project-Id: d700a53aa25849e0afd562b05881d09a Apr 11 15:51:42 user devstack@n-api.service[61166]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1491000769 Apr 11 15:51:42 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 15:51:42 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 15:51:42 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d700a53aa25849e0afd562b05881d09a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d700a53aa25849e0afd562b05881d09a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d700a53aa25849e0afd562b05881d09a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:51:42 user devstack@n-api.service[61166]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1491000769 Apr 11 15:51:42 user devstack@n-api.service[61166]: X-Tenant-Id: d700a53aa25849e0afd562b05881d09a Apr 11 15:51:42 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1491000769 Apr 11 15:51:42 user devstack@n-api.service[61166]: X-User: tempest-ServerRescueNegativeTestJSON-1491000769-project-member Apr 11 15:51:42 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 15:51:42 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 15:51:42 user devstack@n-api.service[61166]: X-User-Id: 5c8492f96e5d4f54aaae3679c82b6759 Apr 11 15:51:42 user devstack@n-api.service[61166]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1491000769-project-member Apr 11 15:51:42 user devstack@n-api.service[61166]: method: > Apr 11 15:51:42 user devstack@n-api.service[61166]: exception: Instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a could not be found. Apr 11 15:51:42 user devstack@n-api.service[61166]: action_args: {'id': 'c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a'} Apr 11 15:51:42 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a could not be found. Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a could not be found. Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a could not be found. Apr 11 15:51:42 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:51:42 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-1b7bdcc4-662b-4ded-860e-f85f324ee97d tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Returning 404 to user: Instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a could not be found. {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:51:42 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-1b7bdcc4-662b-4ded-860e-f85f324ee97d tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" status: 404 len: 111 microversion: 2.1 time: 0.030999 Apr 11 15:51:42 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 304/917] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:51:41 2023] GET /compute/v2.1/servers/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:51:42 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-49487402-9a41-4b7e-8da0-59dab1f46aa6 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Calling method '.version_select at 0x7f4c2edf8310>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:51:42 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-49487402-9a41-4b7e-8da0-59dab1f46aa6 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1367691795" status: 202 len: 0 microversion: 2.1 time: 0.023072 Apr 11 15:51:42 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 310/918] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 15:51:42 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1367691795 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:51:46 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:51:46 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:51:46 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:51:46 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:51:46 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:51:46 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:51:46 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:51:46 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:51:46 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Going to try to terminate instance {{(pid=61165) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:51:46 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/058df5ba-07ab-4bdd-9a47-907e7b0e0e59" status: 204 len: 0 microversion: 2.1 time: 0.128111 Apr 11 15:51:46 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 305/919] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:51:46 2023] DELETE /compute/v2.1/servers/058df5ba-07ab-4bdd-9a47-907e7b0e0e59 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:51:46 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-7349c9ce-5c5e-4023-9690-b4e432c05b22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:51:46 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-7349c9ce-5c5e-4023-9690-b4e432c05b22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:51:46 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-7349c9ce-5c5e-4023-9690-b4e432c05b22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:51:46 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-7349c9ce-5c5e-4023-9690-b4e432c05b22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:51:46 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-7349c9ce-5c5e-4023-9690-b4e432c05b22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:51:46 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-7349c9ce-5c5e-4023-9690-b4e432c05b22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:51:46 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-7349c9ce-5c5e-4023-9690-b4e432c05b22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:51:46 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-7349c9ce-5c5e-4023-9690-b4e432c05b22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:51:46 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-7349c9ce-5c5e-4023-9690-b4e432c05b22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8492f96e5d4f54aaae3679c82b6759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd700a53aa25849e0afd562b05881d09a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:51:46 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-7349c9ce-5c5e-4023-9690-b4e432c05b22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/058df5ba-07ab-4bdd-9a47-907e7b0e0e59" status: 200 len: 1496 microversion: 2.1 time: 0.157445 Apr 11 15:51:46 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 305/920] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:51:46 2023] GET /compute/v2.1/servers/058df5ba-07ab-4bdd-9a47-907e7b0e0e59 => generated 1496 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:51:46 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:51:46 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-254683e8-7586-4a70-8940-203a34c3c38f req-45af040e-8576-4d91-8695-e648529e1ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "058df5ba-07ab-4bdd-9a47-907e7b0e0e59", "name": "network-vif-unplugged", "status": "completed", "tag": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:51:46 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-254683e8-7586-4a70-8940-203a34c3c38f req-45af040e-8576-4d91-8695-e648529e1ad2 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:51:46 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-254683e8-7586-4a70-8940-203a34c3c38f req-45af040e-8576-4d91-8695-e648529e1ad2 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:51:46 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-254683e8-7586-4a70-8940-203a34c3c38f req-45af040e-8576-4d91-8695-e648529e1ad2 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:51:46 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-254683e8-7586-4a70-8940-203a34c3c38f req-45af040e-8576-4d91-8695-e648529e1ad2 service nova] Creating event network-vif-unplugged:cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 for instance 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 on user Apr 11 15:51:46 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-254683e8-7586-4a70-8940-203a34c3c38f req-45af040e-8576-4d91-8695-e648529e1ad2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035762 Apr 11 15:51:46 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 311/921] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:51:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:51:47 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-f4055a34-5ab4-43d8-9a5c-5c2c4a779844 req-f4387862-ba60-437c-88cb-5c54450789d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "058df5ba-07ab-4bdd-9a47-907e7b0e0e59", "name": "network-vif-deleted", "tag": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:51:47 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-f4055a34-5ab4-43d8-9a5c-5c2c4a779844 req-f4387862-ba60-437c-88cb-5c54450789d9 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:51:47 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-f4055a34-5ab4-43d8-9a5c-5c2c4a779844 req-f4387862-ba60-437c-88cb-5c54450789d9 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:51:47 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-f4055a34-5ab4-43d8-9a5c-5c2c4a779844 req-f4387862-ba60-437c-88cb-5c54450789d9 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:51:47 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-f4055a34-5ab4-43d8-9a5c-5c2c4a779844 req-f4387862-ba60-437c-88cb-5c54450789d9 service nova] Creating event network-vif-deleted:cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 for instance 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 on user Apr 11 15:51:47 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-f4055a34-5ab4-43d8-9a5c-5c2c4a779844 req-f4387862-ba60-437c-88cb-5c54450789d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038273 Apr 11 15:51:47 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 306/922] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:51:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:51:48 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-53b4a8fd-31e8-488e-9d51-d9a54fb34a08 req-9c37227e-d874-4f66-86c4-4ff644c2ca59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "058df5ba-07ab-4bdd-9a47-907e7b0e0e59", "name": "network-vif-plugged", "status": "completed", "tag": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:51:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-53b4a8fd-31e8-488e-9d51-d9a54fb34a08 req-9c37227e-d874-4f66-86c4-4ff644c2ca59 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:51:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-53b4a8fd-31e8-488e-9d51-d9a54fb34a08 req-9c37227e-d874-4f66-86c4-4ff644c2ca59 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:51:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-53b4a8fd-31e8-488e-9d51-d9a54fb34a08 req-9c37227e-d874-4f66-86c4-4ff644c2ca59 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:51:48 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-53b4a8fd-31e8-488e-9d51-d9a54fb34a08 req-9c37227e-d874-4f66-86c4-4ff644c2ca59 service nova] Creating event network-vif-plugged:cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 for instance 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 on user Apr 11 15:51:48 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-53b4a8fd-31e8-488e-9d51-d9a54fb34a08 req-9c37227e-d874-4f66-86c4-4ff644c2ca59 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028436 Apr 11 15:51:48 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 306/923] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:51:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:51:51 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:51:51 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:51:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:51:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:51:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:51:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:51:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:51:51 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:51:51 user devstack@n-api.service[61167]: DEBUG nova.objects.instance [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lazy-loading 'services' on Instance uuid f0fc18ff-897c-4f97-95b6-9f25d11dba88 {{(pid=61167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 15:51:51 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88/os-volume_attachments/5da66830-cebd-441e-8573-1480f8fe8e15" status: 202 len: 0 microversion: 2.1 time: 0.314459 Apr 11 15:51:51 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 312/924] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 15:51:51 2023] DELETE /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88/os-volume_attachments/5da66830-cebd-441e-8573-1480f8fe8e15 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:51:51 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-808cee78-5b1d-492a-b669-ba20de5ae4e2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:51:51 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-808cee78-5b1d-492a-b669-ba20de5ae4e2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:51:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-808cee78-5b1d-492a-b669-ba20de5ae4e2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:51:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-808cee78-5b1d-492a-b669-ba20de5ae4e2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:51:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-808cee78-5b1d-492a-b669-ba20de5ae4e2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:51:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-808cee78-5b1d-492a-b669-ba20de5ae4e2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:51:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-808cee78-5b1d-492a-b669-ba20de5ae4e2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:51:51 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-808cee78-5b1d-492a-b669-ba20de5ae4e2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:51:51 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-808cee78-5b1d-492a-b669-ba20de5ae4e2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048224 Apr 11 15:51:51 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 307/925] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:51:51 2023] GET /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:52:22 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=8 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:52:22 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=12 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:52:22 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-e3a913b3-2090-4daa-91e4-a61d2f5f3c17 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:52:22 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-e3a913b3-2090-4daa-91e4-a61d2f5f3c17 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:52:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e3a913b3-2090-4daa-91e4-a61d2f5f3c17 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:52:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e3a913b3-2090-4daa-91e4-a61d2f5f3c17 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:52:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e3a913b3-2090-4daa-91e4-a61d2f5f3c17 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:52:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e3a913b3-2090-4daa-91e4-a61d2f5f3c17 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:52:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e3a913b3-2090-4daa-91e4-a61d2f5f3c17 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:52:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e3a913b3-2090-4daa-91e4-a61d2f5f3c17 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:52:23 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-e3a913b3-2090-4daa-91e4-a61d2f5f3c17 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2110b74f38642afa560e1c9790d3f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312851c65ba1434691eca0cd2a8cd6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:52:23 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-e3a913b3-2090-4daa-91e4-a61d2f5f3c17 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/507b2cc1-0a6c-4ae2-a254-3a991f495fe3" status: 200 len: 1443 microversion: 2.1 time: 0.233976 Apr 11 15:52:23 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 307/926] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:52:22 2023] GET /compute/v2.1/servers/507b2cc1-0a6c-4ae2-a254-3a991f495fe3 => generated 1443 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:52:24 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:52:24 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:52:24 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-3555d724-613c-4596-a92a-386d1f18bec0 req-d4bc0fb8-a714-45cd-b4fb-f6a6ecd451cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "507b2cc1-0a6c-4ae2-a254-3a991f495fe3", "tag": "ffa45d48-79f2-4055-bb7c-33172e34fb8b"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:52:24 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-3555d724-613c-4596-a92a-386d1f18bec0 req-d4bc0fb8-a714-45cd-b4fb-f6a6ecd451cd service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:52:24 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-3555d724-613c-4596-a92a-386d1f18bec0 req-d4bc0fb8-a714-45cd-b4fb-f6a6ecd451cd service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:52:24 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-3555d724-613c-4596-a92a-386d1f18bec0 req-d4bc0fb8-a714-45cd-b4fb-f6a6ecd451cd service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:52:24 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-3555d724-613c-4596-a92a-386d1f18bec0 req-d4bc0fb8-a714-45cd-b4fb-f6a6ecd451cd service nova] Creating event network-changed:ffa45d48-79f2-4055-bb7c-33172e34fb8b for instance 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 on user Apr 11 15:52:24 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-3555d724-613c-4596-a92a-386d1f18bec0 req-d4bc0fb8-a714-45cd-b4fb-f6a6ecd451cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040114 Apr 11 15:52:24 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 313/927] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:52:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:52:24 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:52:24 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:52:24 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:52:24 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:52:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:52:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:52:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:52:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:52:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:52:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:52:24 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Going to try to terminate instance {{(pid=61165) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:52:24 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/507b2cc1-0a6c-4ae2-a254-3a991f495fe3" status: 204 len: 0 microversion: 2.1 time: 0.131870 Apr 11 15:52:24 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 308/928] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:52:24 2023] DELETE /compute/v2.1/servers/507b2cc1-0a6c-4ae2-a254-3a991f495fe3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:52:24 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-af39c082-c9c0-4abe-bd9e-ba0d6179e569 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:52:24 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-af39c082-c9c0-4abe-bd9e-ba0d6179e569 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:52:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-af39c082-c9c0-4abe-bd9e-ba0d6179e569 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:52:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-af39c082-c9c0-4abe-bd9e-ba0d6179e569 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:52:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-af39c082-c9c0-4abe-bd9e-ba0d6179e569 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:52:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-af39c082-c9c0-4abe-bd9e-ba0d6179e569 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:52:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-af39c082-c9c0-4abe-bd9e-ba0d6179e569 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:52:24 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-af39c082-c9c0-4abe-bd9e-ba0d6179e569 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:52:25 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-af39c082-c9c0-4abe-bd9e-ba0d6179e569 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2110b74f38642afa560e1c9790d3f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312851c65ba1434691eca0cd2a8cd6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:52:25 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-af39c082-c9c0-4abe-bd9e-ba0d6179e569 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/507b2cc1-0a6c-4ae2-a254-3a991f495fe3" status: 200 len: 1449 microversion: 2.1 time: 0.171916 Apr 11 15:52:25 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 308/929] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:52:24 2023] GET /compute/v2.1/servers/507b2cc1-0a6c-4ae2-a254-3a991f495fe3 => generated 1449 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:52:25 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-0a2a2004-6998-4c54-b618-19236ad66653 req-ce667451-5c05-48cd-9838-2d25727009fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "507b2cc1-0a6c-4ae2-a254-3a991f495fe3", "name": "network-vif-unplugged", "status": "completed", "tag": "ffa45d48-79f2-4055-bb7c-33172e34fb8b"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:52:25 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-0a2a2004-6998-4c54-b618-19236ad66653 req-ce667451-5c05-48cd-9838-2d25727009fe service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:52:25 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-0a2a2004-6998-4c54-b618-19236ad66653 req-ce667451-5c05-48cd-9838-2d25727009fe service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:52:25 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-0a2a2004-6998-4c54-b618-19236ad66653 req-ce667451-5c05-48cd-9838-2d25727009fe service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:52:25 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-0a2a2004-6998-4c54-b618-19236ad66653 req-ce667451-5c05-48cd-9838-2d25727009fe service nova] Creating event network-vif-unplugged:ffa45d48-79f2-4055-bb7c-33172e34fb8b for instance 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 on user Apr 11 15:52:25 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-0a2a2004-6998-4c54-b618-19236ad66653 req-ce667451-5c05-48cd-9838-2d25727009fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037516 Apr 11 15:52:25 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 314/930] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:52:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:52:26 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-d2d45ffc-4895-4bce-8695-160c25cba99f req-9b19cbb4-d536-4b96-b668-8095d47775f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "507b2cc1-0a6c-4ae2-a254-3a991f495fe3", "name": "network-vif-deleted", "tag": "ffa45d48-79f2-4055-bb7c-33172e34fb8b"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:52:26 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-d2d45ffc-4895-4bce-8695-160c25cba99f req-9b19cbb4-d536-4b96-b668-8095d47775f8 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:52:26 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-d2d45ffc-4895-4bce-8695-160c25cba99f req-9b19cbb4-d536-4b96-b668-8095d47775f8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:52:26 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-d2d45ffc-4895-4bce-8695-160c25cba99f req-9b19cbb4-d536-4b96-b668-8095d47775f8 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:52:26 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-d2d45ffc-4895-4bce-8695-160c25cba99f req-9b19cbb4-d536-4b96-b668-8095d47775f8 service nova] Creating event network-vif-deleted:ffa45d48-79f2-4055-bb7c-33172e34fb8b for instance 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 on user Apr 11 15:52:26 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-d2d45ffc-4895-4bce-8695-160c25cba99f req-9b19cbb4-d536-4b96-b668-8095d47775f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033384 Apr 11 15:52:26 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 309/931] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:52:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:52:27 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "507b2cc1-0a6c-4ae2-a254-3a991f495fe3", "name": "network-vif-plugged", "status": "completed", "tag": "ffa45d48-79f2-4055-bb7c-33172e34fb8b"}, {"server_uuid": "507b2cc1-0a6c-4ae2-a254-3a991f495fe3", "name": "network-vif-plugged", "status": "completed", "tag": "ffa45d48-79f2-4055-bb7c-33172e34fb8b"}, {"server_uuid": "507b2cc1-0a6c-4ae2-a254-3a991f495fe3", "name": "network-vif-plugged", "status": "completed", "tag": "ffa45d48-79f2-4055-bb7c-33172e34fb8b"}, {"server_uuid": "507b2cc1-0a6c-4ae2-a254-3a991f495fe3", "name": "network-vif-unplugged", "status": "completed", "tag": "ffa45d48-79f2-4055-bb7c-33172e34fb8b"}, {"server_uuid": "507b2cc1-0a6c-4ae2-a254-3a991f495fe3", "name": "network-vif-plugged", "status": "completed", "tag": "ffa45d48-79f2-4055-bb7c-33172e34fb8b"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:52:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:52:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:52:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:52:27 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] Creating event network-vif-plugged:ffa45d48-79f2-4055-bb7c-33172e34fb8b for instance 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 on user Apr 11 15:52:27 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] Creating event network-vif-plugged:ffa45d48-79f2-4055-bb7c-33172e34fb8b for instance 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 on user Apr 11 15:52:27 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] Creating event network-vif-plugged:ffa45d48-79f2-4055-bb7c-33172e34fb8b for instance 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 on user Apr 11 15:52:27 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] Creating event network-vif-unplugged:ffa45d48-79f2-4055-bb7c-33172e34fb8b for instance 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 on user Apr 11 15:52:27 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] Creating event network-vif-plugged:ffa45d48-79f2-4055-bb7c-33172e34fb8b for instance 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 on user Apr 11 15:52:27 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.029997 Apr 11 15:52:27 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 309/932] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:52:27 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:52:36 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=4 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:52:36 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=4 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:52:36 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-edff529f-c0c1-4985-96c6-134494b9e2a7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:52:36 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-edff529f-c0c1-4985-96c6-134494b9e2a7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:52:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-edff529f-c0c1-4985-96c6-134494b9e2a7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:52:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-edff529f-c0c1-4985-96c6-134494b9e2a7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:52:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-edff529f-c0c1-4985-96c6-134494b9e2a7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:52:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-edff529f-c0c1-4985-96c6-134494b9e2a7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:52:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-edff529f-c0c1-4985-96c6-134494b9e2a7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:52:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-edff529f-c0c1-4985-96c6-134494b9e2a7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:52:36 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-edff529f-c0c1-4985-96c6-134494b9e2a7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] HTTP exception thrown: Instance 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 could not be found. Apr 11 15:52:36 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-edff529f-c0c1-4985-96c6-134494b9e2a7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Request method failure captured: Apr 11 15:52:36 user devstack@n-api.service[61167]: request: GET /compute/v2.1/servers/058df5ba-07ab-4bdd-9a47-907e7b0e0e59 HTTP/1.1 Apr 11 15:52:36 user devstack@n-api.service[61167]: Accept: application/json Apr 11 15:52:36 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 15:52:36 user devstack@n-api.service[61167]: Connection: close Apr 11 15:52:36 user devstack@n-api.service[61167]: Content-Length: 0 Apr 11 15:52:36 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 15:52:36 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 15:52:36 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 15:52:36 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 15:52:36 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNX5Xpp64UjUCTvokQPchz3Z_zzZld6Gzzdi5g5f3dAzZMYNbfpuD5SVzUtCVXDSbv-6uA4tdlV5bq4l7Mfh7qU6Z3TnkgMq20ehg7ZRY4FWJXSHNtB12atJ6Is1L1bASyUvXy3UohCr63-e-VGzFJVGpcxBwakeRjEJokogPDcce5GQ Apr 11 15:52:36 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 15:52:36 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 15:52:36 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 15:52:36 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 15:52:36 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 15:52:36 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 15:52:36 user devstack@n-api.service[61167]: X-Project-Id: d700a53aa25849e0afd562b05881d09a Apr 11 15:52:36 user devstack@n-api.service[61167]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1491000769 Apr 11 15:52:36 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 15:52:36 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 15:52:36 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d700a53aa25849e0afd562b05881d09a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d700a53aa25849e0afd562b05881d09a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d700a53aa25849e0afd562b05881d09a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:52:36 user devstack@n-api.service[61167]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1491000769 Apr 11 15:52:36 user devstack@n-api.service[61167]: X-Tenant-Id: d700a53aa25849e0afd562b05881d09a Apr 11 15:52:36 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1491000769 Apr 11 15:52:36 user devstack@n-api.service[61167]: X-User: tempest-ServerRescueNegativeTestJSON-1491000769-project-member Apr 11 15:52:36 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 15:52:36 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 15:52:36 user devstack@n-api.service[61167]: X-User-Id: 5c8492f96e5d4f54aaae3679c82b6759 Apr 11 15:52:36 user devstack@n-api.service[61167]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1491000769-project-member Apr 11 15:52:36 user devstack@n-api.service[61167]: method: > Apr 11 15:52:36 user devstack@n-api.service[61167]: exception: Instance 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 could not be found. Apr 11 15:52:36 user devstack@n-api.service[61167]: action_args: {'id': '058df5ba-07ab-4bdd-9a47-907e7b0e0e59'} Apr 11 15:52:36 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 could not be found. Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 could not be found. Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 could not be found. Apr 11 15:52:36 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:52:36 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-edff529f-c0c1-4985-96c6-134494b9e2a7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Returning 404 to user: Instance 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 could not be found. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:52:36 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-edff529f-c0c1-4985-96c6-134494b9e2a7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/058df5ba-07ab-4bdd-9a47-907e7b0e0e59" status: 404 len: 111 microversion: 2.1 time: 0.081721 Apr 11 15:52:36 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 315/933] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:52:36 2023] GET /compute/v2.1/servers/058df5ba-07ab-4bdd-9a47-907e7b0e0e59 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:52:36 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:52:36 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:52:36 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:52:36 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:52:36 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:52:36 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:52:36 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:52:36 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:52:36 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Going to try to terminate instance {{(pid=61165) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:52:36 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6f6ae64a-c760-4ba3-8a50-d380835d9913" status: 204 len: 0 microversion: 2.1 time: 0.116902 Apr 11 15:52:36 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 310/934] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:52:36 2023] DELETE /compute/v2.1/servers/6f6ae64a-c760-4ba3-8a50-d380835d9913 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:52:36 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-4ede3037-c2e0-4a34-8c57-f478b15c9c1d tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:52:36 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-4ede3037-c2e0-4a34-8c57-f478b15c9c1d tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:52:36 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4ede3037-c2e0-4a34-8c57-f478b15c9c1d tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:52:36 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4ede3037-c2e0-4a34-8c57-f478b15c9c1d tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:52:36 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4ede3037-c2e0-4a34-8c57-f478b15c9c1d tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:52:36 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4ede3037-c2e0-4a34-8c57-f478b15c9c1d tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:52:36 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4ede3037-c2e0-4a34-8c57-f478b15c9c1d tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:52:36 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4ede3037-c2e0-4a34-8c57-f478b15c9c1d tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:52:36 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-4ede3037-c2e0-4a34-8c57-f478b15c9c1d tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8492f96e5d4f54aaae3679c82b6759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd700a53aa25849e0afd562b05881d09a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:52:36 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-4ede3037-c2e0-4a34-8c57-f478b15c9c1d tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f6ae64a-c760-4ba3-8a50-d380835d9913" status: 200 len: 1511 microversion: 2.1 time: 0.282023 Apr 11 15:52:36 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 310/935] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:52:36 2023] GET /compute/v2.1/servers/6f6ae64a-c760-4ba3-8a50-d380835d9913 => generated 1511 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:52:36 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-422c44e5-0e8f-4584-aebe-bdd3630aa383 req-7814dbdd-aa98-4396-b6c5-53c2391025ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f6ae64a-c760-4ba3-8a50-d380835d9913", "name": "network-vif-unplugged", "status": "completed", "tag": "2b891eeb-973f-492a-9059-55961bb956bf"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:52:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-422c44e5-0e8f-4584-aebe-bdd3630aa383 req-7814dbdd-aa98-4396-b6c5-53c2391025ca service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:52:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-422c44e5-0e8f-4584-aebe-bdd3630aa383 req-7814dbdd-aa98-4396-b6c5-53c2391025ca service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:52:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-422c44e5-0e8f-4584-aebe-bdd3630aa383 req-7814dbdd-aa98-4396-b6c5-53c2391025ca service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:52:36 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-422c44e5-0e8f-4584-aebe-bdd3630aa383 req-7814dbdd-aa98-4396-b6c5-53c2391025ca service nova] Creating event network-vif-unplugged:2b891eeb-973f-492a-9059-55961bb956bf for instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 on user Apr 11 15:52:36 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-422c44e5-0e8f-4584-aebe-bdd3630aa383 req-7814dbdd-aa98-4396-b6c5-53c2391025ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036800 Apr 11 15:52:36 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 316/936] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:52:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:52:38 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-5183c3ab-82fd-48b2-8aab-1225743a0788 req-b2be6553-bf36-48b6-b82b-931df93f974d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f6ae64a-c760-4ba3-8a50-d380835d9913", "name": "network-vif-plugged", "status": "completed", "tag": "2b891eeb-973f-492a-9059-55961bb956bf"}, {"server_uuid": "6f6ae64a-c760-4ba3-8a50-d380835d9913", "name": "network-vif-deleted", "tag": "2b891eeb-973f-492a-9059-55961bb956bf"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:52:38 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-5183c3ab-82fd-48b2-8aab-1225743a0788 req-b2be6553-bf36-48b6-b82b-931df93f974d service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:52:38 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-5183c3ab-82fd-48b2-8aab-1225743a0788 req-b2be6553-bf36-48b6-b82b-931df93f974d service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:52:38 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-5183c3ab-82fd-48b2-8aab-1225743a0788 req-b2be6553-bf36-48b6-b82b-931df93f974d service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:52:39 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-5183c3ab-82fd-48b2-8aab-1225743a0788 req-b2be6553-bf36-48b6-b82b-931df93f974d service nova] Creating event network-vif-plugged:2b891eeb-973f-492a-9059-55961bb956bf for instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 on user Apr 11 15:52:39 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-5183c3ab-82fd-48b2-8aab-1225743a0788 req-b2be6553-bf36-48b6-b82b-931df93f974d service nova] Creating event network-vif-deleted:2b891eeb-973f-492a-9059-55961bb956bf for instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 on user Apr 11 15:52:39 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-5183c3ab-82fd-48b2-8aab-1225743a0788 req-b2be6553-bf36-48b6-b82b-931df93f974d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030446 Apr 11 15:52:39 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 311/937] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:52:38 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:52:41 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-68431008-ffe6-47d8-942c-5348f3492fa4 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:52:41 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-68431008-ffe6-47d8-942c-5348f3492fa4 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:52:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-68431008-ffe6-47d8-942c-5348f3492fa4 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:52:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-68431008-ffe6-47d8-942c-5348f3492fa4 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:52:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-68431008-ffe6-47d8-942c-5348f3492fa4 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:52:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-68431008-ffe6-47d8-942c-5348f3492fa4 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:52:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-68431008-ffe6-47d8-942c-5348f3492fa4 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:52:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-68431008-ffe6-47d8-942c-5348f3492fa4 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:52:42 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-68431008-ffe6-47d8-942c-5348f3492fa4 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042475 Apr 11 15:52:42 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 311/938] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 15:52:41 2023] GET /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 15:52:43 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-d6dcc49f-4580-4fcc-b387-b85188a95953 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Calling method '.version_select at 0x7f4c2ed6edd0>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:52:43 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-d6dcc49f-4580-4fcc-b387-b85188a95953 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/914ad610-2e93-41cc-9c53-514927e371f8" status: 204 len: 0 microversion: 2.1 time: 0.237929 Apr 11 15:52:43 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 317/939] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:52:43 2023] DELETE /compute/v2.1/images/914ad610-2e93-41cc-9c53-514927e371f8 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:52:43 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:52:43 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:52:43 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:52:43 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:52:43 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:52:43 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:52:43 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:52:43 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:52:43 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Going to try to terminate instance {{(pid=61165) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:52:43 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88" status: 204 len: 0 microversion: 2.1 time: 0.110935 Apr 11 15:52:43 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 312/940] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:52:43 2023] DELETE /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:52:43 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-75fc1aaf-d070-4c8e-a6ca-e9b1f5f3efe7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:52:43 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-75fc1aaf-d070-4c8e-a6ca-e9b1f5f3efe7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:52:43 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-75fc1aaf-d070-4c8e-a6ca-e9b1f5f3efe7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:52:43 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-75fc1aaf-d070-4c8e-a6ca-e9b1f5f3efe7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:52:43 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-75fc1aaf-d070-4c8e-a6ca-e9b1f5f3efe7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:52:43 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-75fc1aaf-d070-4c8e-a6ca-e9b1f5f3efe7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:52:43 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-75fc1aaf-d070-4c8e-a6ca-e9b1f5f3efe7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:52:43 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-75fc1aaf-d070-4c8e-a6ca-e9b1f5f3efe7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:52:43 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-75fc1aaf-d070-4c8e-a6ca-e9b1f5f3efe7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b244004380d43699c5a06e817224b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c9dbdbc7b641f096dc292ea7bf7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:52:43 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-75fc1aaf-d070-4c8e-a6ca-e9b1f5f3efe7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88" status: 200 len: 1678 microversion: 2.1 time: 0.153271 Apr 11 15:52:43 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 312/941] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:52:43 2023] GET /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:52:43 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-636ace80-60be-4c70-8e2f-6a835dbce17f req-2c7da8b2-0d23-4365-8125-ae851b1de576 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0fc18ff-897c-4f97-95b6-9f25d11dba88", "name": "network-vif-unplugged", "status": "completed", "tag": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:52:43 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-636ace80-60be-4c70-8e2f-6a835dbce17f req-2c7da8b2-0d23-4365-8125-ae851b1de576 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:52:43 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-636ace80-60be-4c70-8e2f-6a835dbce17f req-2c7da8b2-0d23-4365-8125-ae851b1de576 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:52:43 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-636ace80-60be-4c70-8e2f-6a835dbce17f req-2c7da8b2-0d23-4365-8125-ae851b1de576 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:52:43 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-636ace80-60be-4c70-8e2f-6a835dbce17f req-2c7da8b2-0d23-4365-8125-ae851b1de576 service nova] Creating event network-vif-unplugged:cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 for instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 on user Apr 11 15:52:43 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-636ace80-60be-4c70-8e2f-6a835dbce17f req-2c7da8b2-0d23-4365-8125-ae851b1de576 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029024 Apr 11 15:52:43 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 318/942] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:52:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:52:45 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-e3da1f23-c521-40ef-a361-e8dabc8cdb5e req-78f879d2-4588-47da-bb58-c15f185498d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0fc18ff-897c-4f97-95b6-9f25d11dba88", "name": "network-vif-plugged", "status": "completed", "tag": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01"}, {"server_uuid": "f0fc18ff-897c-4f97-95b6-9f25d11dba88", "name": "network-vif-deleted", "tag": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:52:45 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-e3da1f23-c521-40ef-a361-e8dabc8cdb5e req-78f879d2-4588-47da-bb58-c15f185498d6 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:52:45 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-e3da1f23-c521-40ef-a361-e8dabc8cdb5e req-78f879d2-4588-47da-bb58-c15f185498d6 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:52:45 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-e3da1f23-c521-40ef-a361-e8dabc8cdb5e req-78f879d2-4588-47da-bb58-c15f185498d6 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:52:45 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-e3da1f23-c521-40ef-a361-e8dabc8cdb5e req-78f879d2-4588-47da-bb58-c15f185498d6 service nova] Creating event network-vif-plugged:cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 for instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 on user Apr 11 15:52:45 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-e3da1f23-c521-40ef-a361-e8dabc8cdb5e req-78f879d2-4588-47da-bb58-c15f185498d6 service nova] Creating event network-vif-deleted:cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 for instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 on user Apr 11 15:52:45 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-e3da1f23-c521-40ef-a361-e8dabc8cdb5e req-78f879d2-4588-47da-bb58-c15f185498d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033155 Apr 11 15:52:45 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 313/943] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:52:45 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:53:15 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=12 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:53:15 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=32 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:53:15 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-8d8efc3a-40e7-4bdb-ab8a-4a450432df7c tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:53:15 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-8d8efc3a-40e7-4bdb-ab8a-4a450432df7c tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:53:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8d8efc3a-40e7-4bdb-ab8a-4a450432df7c tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:53:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8d8efc3a-40e7-4bdb-ab8a-4a450432df7c tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:53:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8d8efc3a-40e7-4bdb-ab8a-4a450432df7c tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:53:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8d8efc3a-40e7-4bdb-ab8a-4a450432df7c tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:53:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8d8efc3a-40e7-4bdb-ab8a-4a450432df7c tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:53:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8d8efc3a-40e7-4bdb-ab8a-4a450432df7c tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:53:15 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-8d8efc3a-40e7-4bdb-ab8a-4a450432df7c tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] HTTP exception thrown: Instance 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 could not be found. Apr 11 15:53:15 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-8d8efc3a-40e7-4bdb-ab8a-4a450432df7c tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Request method failure captured: Apr 11 15:53:15 user devstack@n-api.service[61166]: request: GET /compute/v2.1/servers/507b2cc1-0a6c-4ae2-a254-3a991f495fe3 HTTP/1.1 Apr 11 15:53:15 user devstack@n-api.service[61166]: Accept: application/json Apr 11 15:53:15 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 15:53:15 user devstack@n-api.service[61166]: Connection: close Apr 11 15:53:15 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 15:53:15 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 15:53:15 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 15:53:15 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 15:53:15 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 15:53:15 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNX_MfySgeWQGetehYkoHqYg1G1945hTNCEJ0iZ6MzpnT3yZAJa_LjZxGoo77mYeoWNM22txPKHxqCAJQHMF1JaEqPSco0vUdydRE47pwKZna0AOIEDnSU3nak09PN7xX11kpifNQbUB7HIx3dygnGm9WJh4EQWIeaVGEcb-QhV49Vog Apr 11 15:53:15 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 15:53:15 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 15:53:15 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 15:53:15 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 15:53:15 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 15:53:15 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 15:53:15 user devstack@n-api.service[61166]: X-Project-Id: 312851c65ba1434691eca0cd2a8cd6d2 Apr 11 15:53:15 user devstack@n-api.service[61166]: X-Project-Name: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:53:15 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 15:53:15 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 15:53:15 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:53:15 user devstack@n-api.service[61166]: X-Tenant: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:53:15 user devstack@n-api.service[61166]: X-Tenant-Id: 312851c65ba1434691eca0cd2a8cd6d2 Apr 11 15:53:15 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:53:15 user devstack@n-api.service[61166]: X-User: tempest-TestVolumeBootPattern-1933582504-project-member Apr 11 15:53:15 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 15:53:15 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 15:53:15 user devstack@n-api.service[61166]: X-User-Id: c2110b74f38642afa560e1c9790d3f81 Apr 11 15:53:15 user devstack@n-api.service[61166]: X-User-Name: tempest-TestVolumeBootPattern-1933582504-project-member Apr 11 15:53:15 user devstack@n-api.service[61166]: method: > Apr 11 15:53:15 user devstack@n-api.service[61166]: exception: Instance 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 could not be found. Apr 11 15:53:15 user devstack@n-api.service[61166]: action_args: {'id': '507b2cc1-0a6c-4ae2-a254-3a991f495fe3'} Apr 11 15:53:15 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 could not be found. Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 could not be found. Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 could not be found. Apr 11 15:53:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:53:15 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-8d8efc3a-40e7-4bdb-ab8a-4a450432df7c tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Returning 404 to user: Instance 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 could not be found. {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:53:15 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-8d8efc3a-40e7-4bdb-ab8a-4a450432df7c tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/507b2cc1-0a6c-4ae2-a254-3a991f495fe3" status: 404 len: 111 microversion: 2.1 time: 0.112276 Apr 11 15:53:15 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 313/944] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:53:15 2023] GET /compute/v2.1/servers/507b2cc1-0a6c-4ae2-a254-3a991f495fe3 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:53:15 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:53:15 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:53:15 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-168309070", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1289860889", "security_groups": [{"name": "tempest-secgroup-smoke-579571176"}], "block_device_mapping_v2": [{"uuid": "8e80be1f-47e3-4658-bdfe-610ca8e958a0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24"}]}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:53:15 user devstack@n-api.service[61167]: DEBUG nova.network.neutron [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] validate_networks() for [('8d262ba8-b9c3-44ed-8431-6c295eb9ea24', None, None, None, None, None)] {{(pid=61167) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:53:15 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Flavor limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:53:15 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Image limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:53:15 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Flavor pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:53:15 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Image pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:53:15 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:53:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:53:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:53:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:53:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:53:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:53:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:53:15 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Getting quotas for project 312851c65ba1434691eca0cd2a8cd6d2. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:53:15 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Getting quotas for user c2110b74f38642afa560e1c9790d3f81 and project 312851c65ba1434691eca0cd2a8cd6d2. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:53:16 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Going to run 1 instances... {{(pid=61167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:53:16 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8e80be1f-47e3-4658-bdfe-610ca8e958a0',volume_size=None,volume_type=None)] {{(pid=61167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:53:16 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.730164 Apr 11 15:53:16 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 319/945] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 15:53:15 2023] POST /compute/v2.1/servers => generated 403 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 15:53:16 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=3 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:53:16 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:53:16 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-44957cd0-5942-406c-9b7d-96fe18a593da tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:53:16 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-44957cd0-5942-406c-9b7d-96fe18a593da tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:53:16 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-44957cd0-5942-406c-9b7d-96fe18a593da tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2110b74f38642afa560e1c9790d3f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312851c65ba1434691eca0cd2a8cd6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:53:16 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-44957cd0-5942-406c-9b7d-96fe18a593da tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56fbe043-133f-4e43-b9db-8ed02a3ed2af" status: 200 len: 1089 microversion: 2.1 time: 0.117291 Apr 11 15:53:16 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 314/946] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:53:16 2023] GET /compute/v2.1/servers/56fbe043-133f-4e43-b9db-8ed02a3ed2af => generated 1089 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:53:18 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-d21dc0b8-2fda-4397-b90e-e48ca4224aa2 req-c31881bc-843f-41f2-8279-59c7d7824b3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56fbe043-133f-4e43-b9db-8ed02a3ed2af", "tag": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:53:18 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-d21dc0b8-2fda-4397-b90e-e48ca4224aa2 req-c31881bc-843f-41f2-8279-59c7d7824b3e service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:53:18 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-d21dc0b8-2fda-4397-b90e-e48ca4224aa2 req-c31881bc-843f-41f2-8279-59c7d7824b3e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:53:18 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-d21dc0b8-2fda-4397-b90e-e48ca4224aa2 req-c31881bc-843f-41f2-8279-59c7d7824b3e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:53:18 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-d21dc0b8-2fda-4397-b90e-e48ca4224aa2 req-c31881bc-843f-41f2-8279-59c7d7824b3e service nova] Creating event network-changed:77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b for instance 56fbe043-133f-4e43-b9db-8ed02a3ed2af on user Apr 11 15:53:18 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-d21dc0b8-2fda-4397-b90e-e48ca4224aa2 req-c31881bc-843f-41f2-8279-59c7d7824b3e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040946 Apr 11 15:53:18 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 314/947] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:53:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:53:24 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-9921dafe-8137-4e88-aad6-fe713a97188f req-bfe27d1d-c682-462d-a410-709b21d237b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56fbe043-133f-4e43-b9db-8ed02a3ed2af", "name": "network-vif-plugged", "status": "completed", "tag": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:53:24 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-9921dafe-8137-4e88-aad6-fe713a97188f req-bfe27d1d-c682-462d-a410-709b21d237b7 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:53:24 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-9921dafe-8137-4e88-aad6-fe713a97188f req-bfe27d1d-c682-462d-a410-709b21d237b7 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:53:24 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-9921dafe-8137-4e88-aad6-fe713a97188f req-bfe27d1d-c682-462d-a410-709b21d237b7 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:53:24 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-9921dafe-8137-4e88-aad6-fe713a97188f req-bfe27d1d-c682-462d-a410-709b21d237b7 service nova] Creating event network-vif-plugged:77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b for instance 56fbe043-133f-4e43-b9db-8ed02a3ed2af on user Apr 11 15:53:24 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-9921dafe-8137-4e88-aad6-fe713a97188f req-bfe27d1d-c682-462d-a410-709b21d237b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084020 Apr 11 15:53:24 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 320/948] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:53:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:53:26 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-3e79a472-b312-48a9-8766-002ebc078e25 req-f8fa174b-0df1-4711-b558-6183a923cff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56fbe043-133f-4e43-b9db-8ed02a3ed2af", "name": "network-vif-plugged", "status": "completed", "tag": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:53:26 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:53:26 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:53:26 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-3e79a472-b312-48a9-8766-002ebc078e25 req-f8fa174b-0df1-4711-b558-6183a923cff9 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:53:26 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-3e79a472-b312-48a9-8766-002ebc078e25 req-f8fa174b-0df1-4711-b558-6183a923cff9 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:53:26 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-3e79a472-b312-48a9-8766-002ebc078e25 req-f8fa174b-0df1-4711-b558-6183a923cff9 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:53:26 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-3e79a472-b312-48a9-8766-002ebc078e25 req-f8fa174b-0df1-4711-b558-6183a923cff9 service nova] Creating event network-vif-plugged:77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b for instance 56fbe043-133f-4e43-b9db-8ed02a3ed2af on user Apr 11 15:53:26 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-3e79a472-b312-48a9-8766-002ebc078e25 req-f8fa174b-0df1-4711-b558-6183a923cff9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034961 Apr 11 15:53:26 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 315/949] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:53:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:53:26 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-b6ab658f-93f9-4bcd-95cc-9ff48d843791 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:53:26 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-b6ab658f-93f9-4bcd-95cc-9ff48d843791 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:53:26 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b6ab658f-93f9-4bcd-95cc-9ff48d843791 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:53:26 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b6ab658f-93f9-4bcd-95cc-9ff48d843791 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:53:26 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b6ab658f-93f9-4bcd-95cc-9ff48d843791 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:53:26 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b6ab658f-93f9-4bcd-95cc-9ff48d843791 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:53:26 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b6ab658f-93f9-4bcd-95cc-9ff48d843791 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:53:26 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b6ab658f-93f9-4bcd-95cc-9ff48d843791 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:53:26 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-b6ab658f-93f9-4bcd-95cc-9ff48d843791 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] HTTP exception thrown: Instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 could not be found. Apr 11 15:53:26 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-b6ab658f-93f9-4bcd-95cc-9ff48d843791 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Request method failure captured: Apr 11 15:53:26 user devstack@n-api.service[61166]: request: GET /compute/v2.1/servers/6f6ae64a-c760-4ba3-8a50-d380835d9913 HTTP/1.1 Apr 11 15:53:26 user devstack@n-api.service[61166]: Accept: application/json Apr 11 15:53:26 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 15:53:26 user devstack@n-api.service[61166]: Connection: close Apr 11 15:53:26 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 15:53:26 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 15:53:26 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 15:53:26 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 15:53:26 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 15:53:26 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNX5Xpp64UjUCTvokQPchz3Z_zzZld6Gzzdi5g5f3dAzZMYNbfpuD5SVzUtCVXDSbv-6uA4tdlV5bq4l7Mfh7qU6Z3TnkgMq20ehg7ZRY4FWJXSHNtB12atJ6Is1L1bASyUvXy3UohCr63-e-VGzFJVGpcxBwakeRjEJokogPDcce5GQ Apr 11 15:53:26 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 15:53:26 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 15:53:26 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 15:53:26 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 15:53:26 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 15:53:26 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 15:53:26 user devstack@n-api.service[61166]: X-Project-Id: d700a53aa25849e0afd562b05881d09a Apr 11 15:53:26 user devstack@n-api.service[61166]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1491000769 Apr 11 15:53:26 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 15:53:26 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 15:53:26 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d700a53aa25849e0afd562b05881d09a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d700a53aa25849e0afd562b05881d09a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d700a53aa25849e0afd562b05881d09a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:53:26 user devstack@n-api.service[61166]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1491000769 Apr 11 15:53:26 user devstack@n-api.service[61166]: X-Tenant-Id: d700a53aa25849e0afd562b05881d09a Apr 11 15:53:26 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1491000769 Apr 11 15:53:26 user devstack@n-api.service[61166]: X-User: tempest-ServerRescueNegativeTestJSON-1491000769-project-member Apr 11 15:53:26 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 15:53:26 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 15:53:26 user devstack@n-api.service[61166]: X-User-Id: 5c8492f96e5d4f54aaae3679c82b6759 Apr 11 15:53:26 user devstack@n-api.service[61166]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1491000769-project-member Apr 11 15:53:26 user devstack@n-api.service[61166]: method: > Apr 11 15:53:26 user devstack@n-api.service[61166]: exception: Instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 could not be found. Apr 11 15:53:26 user devstack@n-api.service[61166]: action_args: {'id': '6f6ae64a-c760-4ba3-8a50-d380835d9913'} Apr 11 15:53:26 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 could not be found. Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 could not be found. Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 could not be found. Apr 11 15:53:26 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:53:26 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-b6ab658f-93f9-4bcd-95cc-9ff48d843791 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Returning 404 to user: Instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 could not be found. {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:53:26 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-b6ab658f-93f9-4bcd-95cc-9ff48d843791 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f6ae64a-c760-4ba3-8a50-d380835d9913" status: 404 len: 111 microversion: 2.1 time: 0.030728 Apr 11 15:53:26 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 315/950] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:53:26 2023] GET /compute/v2.1/servers/6f6ae64a-c760-4ba3-8a50-d380835d9913 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:53:33 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:53:33 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:53:33 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-e521022a-7208-41e3-b177-503ec34f53d6 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:53:33 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-e521022a-7208-41e3-b177-503ec34f53d6 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:53:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e521022a-7208-41e3-b177-503ec34f53d6 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:53:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e521022a-7208-41e3-b177-503ec34f53d6 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:53:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e521022a-7208-41e3-b177-503ec34f53d6 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:53:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e521022a-7208-41e3-b177-503ec34f53d6 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:53:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e521022a-7208-41e3-b177-503ec34f53d6 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:53:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e521022a-7208-41e3-b177-503ec34f53d6 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:53:33 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-e521022a-7208-41e3-b177-503ec34f53d6 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] HTTP exception thrown: Instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 could not be found. Apr 11 15:53:33 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-e521022a-7208-41e3-b177-503ec34f53d6 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Request method failure captured: Apr 11 15:53:33 user devstack@n-api.service[61167]: request: GET /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88 HTTP/1.1 Apr 11 15:53:33 user devstack@n-api.service[61167]: Accept: application/json Apr 11 15:53:33 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 15:53:33 user devstack@n-api.service[61167]: Connection: close Apr 11 15:53:33 user devstack@n-api.service[61167]: Content-Length: 0 Apr 11 15:53:33 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 15:53:33 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 15:53:33 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 15:53:33 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 15:53:33 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNYCrJrNqDsZM3j7k1gDTl7HUWZHsXDyBqtcg5ll4i4rLreIcaPJypc-uiZqwJnuBYBpvHivodtmQ9pSHPmL_LW8VdQp9I9IIWqn0j1bV3jXvMvZkXfKChlXqGLIoR-JYIk8Xt95Dt8PyTjUa7UuLBQCw20D75o9YhpsIm4DahNSw7AU Apr 11 15:53:33 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 15:53:33 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 15:53:33 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 15:53:33 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 15:53:33 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 15:53:33 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 15:53:33 user devstack@n-api.service[61167]: X-Project-Id: 85c9dbdbc7b641f096dc292ea7bf7cd4 Apr 11 15:53:33 user devstack@n-api.service[61167]: X-Project-Name: tempest-ServerStableDeviceRescueTest-1990539250 Apr 11 15:53:33 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 15:53:33 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 15:53:33 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85c9dbdbc7b641f096dc292ea7bf7cd4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/85c9dbdbc7b641f096dc292ea7bf7cd4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/85c9dbdbc7b641f096dc292ea7bf7cd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:53:33 user devstack@n-api.service[61167]: X-Tenant: tempest-ServerStableDeviceRescueTest-1990539250 Apr 11 15:53:33 user devstack@n-api.service[61167]: X-Tenant-Id: 85c9dbdbc7b641f096dc292ea7bf7cd4 Apr 11 15:53:33 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-1990539250 Apr 11 15:53:33 user devstack@n-api.service[61167]: X-User: tempest-ServerStableDeviceRescueTest-1990539250-project-member Apr 11 15:53:33 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 15:53:33 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 15:53:33 user devstack@n-api.service[61167]: X-User-Id: 0b244004380d43699c5a06e817224b3e Apr 11 15:53:33 user devstack@n-api.service[61167]: X-User-Name: tempest-ServerStableDeviceRescueTest-1990539250-project-member Apr 11 15:53:33 user devstack@n-api.service[61167]: method: > Apr 11 15:53:33 user devstack@n-api.service[61167]: exception: Instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 could not be found. Apr 11 15:53:33 user devstack@n-api.service[61167]: action_args: {'id': 'f0fc18ff-897c-4f97-95b6-9f25d11dba88'} Apr 11 15:53:33 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 could not be found. Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 could not be found. Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 could not be found. Apr 11 15:53:33 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:53:33 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-e521022a-7208-41e3-b177-503ec34f53d6 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Returning 404 to user: Instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 could not be found. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:53:33 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-e521022a-7208-41e3-b177-503ec34f53d6 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88" status: 404 len: 111 microversion: 2.1 time: 0.036520 Apr 11 15:53:33 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 321/951] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:53:33 2023] GET /compute/v2.1/servers/f0fc18ff-897c-4f97-95b6-9f25d11dba88 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:53:33 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-b981af41-f596-4c0e-8de8-c471502bbdef tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Calling method '.version_select at 0x7f4c2ebdacb0>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:53:33 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-b981af41-f596-4c0e-8de8-c471502bbdef tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-363003976" status: 202 len: 0 microversion: 2.1 time: 0.026108 Apr 11 15:53:33 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 316/952] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 15:53:33 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-363003976 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:53:45 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:53:45 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:53:45 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-1f5265de-331d-44ed-817f-d3faeac6cc23 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Action: 'create', calling method: .version_select at 0x7f4c2ed38a60>, body: {"keypair": {"name": "tempest-keypair-1501547376", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA++uuXe6FyaUH7+6A7LXI9JAeQOW0LGZU8i83jm7ocQcCkrPDDJFgc0QxuJD62Az+edRqtAEJw2zMA+YyRUWi6KTatWRW/2wsFjFL2TMdY96WvhmRoEL5HXtf0K6rtWuw=="}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:53:45 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-1f5265de-331d-44ed-817f-d3faeac6cc23 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Getting quotas for project 8fa330c512f045dc8a5946be3563fdcd. Resources: {'key_pairs'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:53:45 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-1f5265de-331d-44ed-817f-d3faeac6cc23 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Getting quotas for user aa87f179b35a4d1db2336802e8f104e4 and project 8fa330c512f045dc8a5946be3563fdcd. Resources: {'key_pairs'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:53:45 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-1f5265de-331d-44ed-817f-d3faeac6cc23 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.209908 Apr 11 15:53:45 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 316/953] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 15:53:45 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:53:47 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-873450080", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "e6f9483b-53f6-4696-b451-52aeb6ec13d3"}], "security_groups": [{"name": "tempest-securitygroup--926656351"}], "key_name": "tempest-keypair-1501547376", "user_data": "}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:53:47 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:53:47 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:53:47 user devstack@n-api.service[61167]: DEBUG nova.network.neutron [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] validate_networks() for [('e6f9483b-53f6-4696-b451-52aeb6ec13d3', None, None, None, None, None)] {{(pid=61167) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:53:47 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Flavor limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:53:47 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Image limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:53:47 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Flavor pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:53:47 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Image pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:53:47 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:53:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:53:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:53:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:53:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:53:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:53:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:53:47 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Getting quotas for project 8fa330c512f045dc8a5946be3563fdcd. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:53:47 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Getting quotas for user aa87f179b35a4d1db2336802e8f104e4 and project 8fa330c512f045dc8a5946be3563fdcd. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:53:47 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Going to run 1 instances... {{(pid=61167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:53:47 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52fe638c-5ada-47d5-b376-233bfa808a37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:53:47 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.571500 Apr 11 15:53:47 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 322/954] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 15:53:47 2023] POST /compute/v2.1/servers => generated 399 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 15:53:47 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:53:47 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:53:47 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-fbc99889-5263-4b35-8385-2994255144cd tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:53:47 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-fbc99889-5263-4b35-8385-2994255144cd tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:53:47 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-fbc99889-5263-4b35-8385-2994255144cd tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa87f179b35a4d1db2336802e8f104e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa330c512f045dc8a5946be3563fdcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:53:47 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-fbc99889-5263-4b35-8385-2994255144cd tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e" status: 200 len: 1231 microversion: 2.1 time: 0.067767 Apr 11 15:53:47 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 317/955] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:53:47 2023] GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e => generated 1231 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:53:49 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-f2b15ab9-5783-44ee-9bc5-629e78fa61ec req-9a1b03e2-e936-46f9-8a42-ef034dee60bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d6c5972-e53b-47e9-8f13-7df1ad86020e", "tag": "8fd17bd8-2470-4931-8df3-b1ca41125d39"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:53:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-f2b15ab9-5783-44ee-9bc5-629e78fa61ec req-9a1b03e2-e936-46f9-8a42-ef034dee60bd service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:53:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-f2b15ab9-5783-44ee-9bc5-629e78fa61ec req-9a1b03e2-e936-46f9-8a42-ef034dee60bd service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:53:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-f2b15ab9-5783-44ee-9bc5-629e78fa61ec req-9a1b03e2-e936-46f9-8a42-ef034dee60bd service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:53:49 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-f2b15ab9-5783-44ee-9bc5-629e78fa61ec req-9a1b03e2-e936-46f9-8a42-ef034dee60bd service nova] Creating event network-changed:8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e on user Apr 11 15:53:49 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-f2b15ab9-5783-44ee-9bc5-629e78fa61ec req-9a1b03e2-e936-46f9-8a42-ef034dee60bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094304 Apr 11 15:53:49 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 317/956] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:53:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:53:52 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-7120822b-c745-46f1-b5fe-399c542a770c req-a85cf3d7-ca8c-4f9b-8c92-5ee59a67a50f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6c5972-e53b-47e9-8f13-7df1ad86020e", "name": "network-vif-plugged", "status": "completed", "tag": "8fd17bd8-2470-4931-8df3-b1ca41125d39"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:53:52 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-7120822b-c745-46f1-b5fe-399c542a770c req-a85cf3d7-ca8c-4f9b-8c92-5ee59a67a50f service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:53:52 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-7120822b-c745-46f1-b5fe-399c542a770c req-a85cf3d7-ca8c-4f9b-8c92-5ee59a67a50f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:53:52 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-7120822b-c745-46f1-b5fe-399c542a770c req-a85cf3d7-ca8c-4f9b-8c92-5ee59a67a50f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:53:52 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-7120822b-c745-46f1-b5fe-399c542a770c req-a85cf3d7-ca8c-4f9b-8c92-5ee59a67a50f service nova] Creating event network-vif-plugged:8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e on user Apr 11 15:53:52 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-7120822b-c745-46f1-b5fe-399c542a770c req-a85cf3d7-ca8c-4f9b-8c92-5ee59a67a50f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033128 Apr 11 15:53:52 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 323/957] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:53:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:53:54 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-a126fa39-7d61-47ed-836f-e384f4bcf6e0 req-7163897a-f4b3-4175-906e-7644d85b50ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6c5972-e53b-47e9-8f13-7df1ad86020e", "name": "network-vif-plugged", "status": "completed", "tag": "8fd17bd8-2470-4931-8df3-b1ca41125d39"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:53:54 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-a126fa39-7d61-47ed-836f-e384f4bcf6e0 req-7163897a-f4b3-4175-906e-7644d85b50ce service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:53:54 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-a126fa39-7d61-47ed-836f-e384f4bcf6e0 req-7163897a-f4b3-4175-906e-7644d85b50ce service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:53:54 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-a126fa39-7d61-47ed-836f-e384f4bcf6e0 req-7163897a-f4b3-4175-906e-7644d85b50ce service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:53:54 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-a126fa39-7d61-47ed-836f-e384f4bcf6e0 req-7163897a-f4b3-4175-906e-7644d85b50ce service nova] Creating event network-vif-plugged:8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e on user Apr 11 15:53:54 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-a126fa39-7d61-47ed-836f-e384f4bcf6e0 req-7163897a-f4b3-4175-906e-7644d85b50ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038188 Apr 11 15:53:54 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 318/958] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:53:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:54:06 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:54:06 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:54:06 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:54:06 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-8a98db52-bc12-49da-9e10-749c86b29617 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:54:06 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-8a98db52-bc12-49da-9e10-749c86b29617 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:54:06 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8a98db52-bc12-49da-9e10-749c86b29617 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:54:06 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8a98db52-bc12-49da-9e10-749c86b29617 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:54:06 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8a98db52-bc12-49da-9e10-749c86b29617 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:54:06 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8a98db52-bc12-49da-9e10-749c86b29617 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:54:06 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8a98db52-bc12-49da-9e10-749c86b29617 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:54:06 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-8a98db52-bc12-49da-9e10-749c86b29617 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:54:06 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-8a98db52-bc12-49da-9e10-749c86b29617 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2110b74f38642afa560e1c9790d3f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312851c65ba1434691eca0cd2a8cd6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:54:06 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-8a98db52-bc12-49da-9e10-749c86b29617 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56fbe043-133f-4e43-b9db-8ed02a3ed2af" status: 200 len: 1441 microversion: 2.1 time: 0.147075 Apr 11 15:54:06 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 318/959] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:54:06 2023] GET /compute/v2.1/servers/56fbe043-133f-4e43-b9db-8ed02a3ed2af => generated 1441 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:54:37 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:54:37 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:54:37 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:54:37 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=4 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:54:37 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-2edfaca1-ce57-481a-afb3-d1c9c48d0ba8 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:54:37 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-2edfaca1-ce57-481a-afb3-d1c9c48d0ba8 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:54:37 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2edfaca1-ce57-481a-afb3-d1c9c48d0ba8 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:54:37 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2edfaca1-ce57-481a-afb3-d1c9c48d0ba8 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:54:37 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2edfaca1-ce57-481a-afb3-d1c9c48d0ba8 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:54:37 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2edfaca1-ce57-481a-afb3-d1c9c48d0ba8 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:54:37 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2edfaca1-ce57-481a-afb3-d1c9c48d0ba8 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:54:37 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-2edfaca1-ce57-481a-afb3-d1c9c48d0ba8 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:54:37 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-2edfaca1-ce57-481a-afb3-d1c9c48d0ba8 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa87f179b35a4d1db2336802e8f104e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa330c512f045dc8a5946be3563fdcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:54:37 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-2edfaca1-ce57-481a-afb3-d1c9c48d0ba8 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e" status: 200 len: 1537 microversion: 2.1 time: 0.160459 Apr 11 15:54:37 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 324/960] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:54:37 2023] GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e => generated 1537 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:55:06 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:55:06 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:55:06 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:55:06 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-ac3dad32-43f2-4e7c-acd4-a50f6037e578 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:55:06 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-ac3dad32-43f2-4e7c-acd4-a50f6037e578 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:55:06 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ac3dad32-43f2-4e7c-acd4-a50f6037e578 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:55:06 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ac3dad32-43f2-4e7c-acd4-a50f6037e578 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:55:06 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ac3dad32-43f2-4e7c-acd4-a50f6037e578 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:55:06 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ac3dad32-43f2-4e7c-acd4-a50f6037e578 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:55:06 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ac3dad32-43f2-4e7c-acd4-a50f6037e578 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:55:06 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ac3dad32-43f2-4e7c-acd4-a50f6037e578 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:55:06 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-ac3dad32-43f2-4e7c-acd4-a50f6037e578 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2110b74f38642afa560e1c9790d3f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312851c65ba1434691eca0cd2a8cd6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:55:06 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-ac3dad32-43f2-4e7c-acd4-a50f6037e578 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56fbe043-133f-4e43-b9db-8ed02a3ed2af" status: 200 len: 1441 microversion: 2.1 time: 0.151640 Apr 11 15:55:06 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 319/961] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:55:06 2023] GET /compute/v2.1/servers/56fbe043-133f-4e43-b9db-8ed02a3ed2af => generated 1441 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:55:08 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:55:08 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:55:08 user devstack@n-api.service[61166]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 15:55:08 user devstack@n-api.service[61166]: Tue Apr 11 15:55:08 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 11 15:55:08 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-e2f89a7d-d1e6-4c23-8c7d-c273d0913996 req-624ea3eb-0a5c-485d-a2f0-5b4c4cf91738 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56fbe043-133f-4e43-b9db-8ed02a3ed2af", "tag": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:55:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-e2f89a7d-d1e6-4c23-8c7d-c273d0913996 req-624ea3eb-0a5c-485d-a2f0-5b4c4cf91738 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:55:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-e2f89a7d-d1e6-4c23-8c7d-c273d0913996 req-624ea3eb-0a5c-485d-a2f0-5b4c4cf91738 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:55:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-e2f89a7d-d1e6-4c23-8c7d-c273d0913996 req-624ea3eb-0a5c-485d-a2f0-5b4c4cf91738 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:55:08 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-e2f89a7d-d1e6-4c23-8c7d-c273d0913996 req-624ea3eb-0a5c-485d-a2f0-5b4c4cf91738 service nova] Creating event network-changed:77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b for instance 56fbe043-133f-4e43-b9db-8ed02a3ed2af on user Apr 11 15:55:08 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-e2f89a7d-d1e6-4c23-8c7d-c273d0913996 req-624ea3eb-0a5c-485d-a2f0-5b4c4cf91738 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044920 Apr 11 15:55:08 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 319/962] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:55:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:55:11 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-171471328", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1289860889", "security_groups": [{"name": "tempest-secgroup-smoke-579571176"}], "block_device_mapping_v2": [{"uuid": "fa9e7f7f-d130-4bd7-abd6-1d4bf3659714", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24"}]}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:55:11 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:55:11 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:55:11 user devstack@n-api.service[61167]: DEBUG nova.network.neutron [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] validate_networks() for [('8d262ba8-b9c3-44ed-8431-6c295eb9ea24', None, None, None, None, None)] {{(pid=61167) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 15:55:11 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Flavor limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 15:55:11 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Image limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 15:55:11 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Flavor pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 15:55:11 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Image pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 15:55:11 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 15:55:11 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:55:11 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:55:11 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:55:11 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:55:11 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:55:11 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:55:11 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Getting quotas for project 312851c65ba1434691eca0cd2a8cd6d2. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 15:55:11 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Getting quotas for user c2110b74f38642afa560e1c9790d3f81 and project 312851c65ba1434691eca0cd2a8cd6d2. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 15:55:11 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Going to run 1 instances... {{(pid=61167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 15:55:11 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fa9e7f7f-d130-4bd7-abd6-1d4bf3659714',volume_size=None,volume_type=None)] {{(pid=61167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 15:55:11 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.669168 Apr 11 15:55:11 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 325/963] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 15:55:11 2023] POST /compute/v2.1/servers => generated 403 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 15:55:11 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-e9e1ee5d-2e51-499e-8cd9-1a2878b92e06 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:55:11 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-e9e1ee5d-2e51-499e-8cd9-1a2878b92e06 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:55:11 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-e9e1ee5d-2e51-499e-8cd9-1a2878b92e06 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2110b74f38642afa560e1c9790d3f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312851c65ba1434691eca0cd2a8cd6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:55:11 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-e9e1ee5d-2e51-499e-8cd9-1a2878b92e06 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7889054a-8f28-4a2b-95b3-ec64dc421681" status: 200 len: 1089 microversion: 2.1 time: 0.091697 Apr 11 15:55:11 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 320/964] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:55:11 2023] GET /compute/v2.1/servers/7889054a-8f28-4a2b-95b3-ec64dc421681 => generated 1089 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:55:13 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-4f867a37-b88f-4c3b-94be-ad2d2bb5041c req-939ab349-b60c-43e2-8e75-dc82b510c8d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7889054a-8f28-4a2b-95b3-ec64dc421681", "tag": "fb3bb75a-7f7c-4611-91bf-313a7f1610b5"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:55:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-4f867a37-b88f-4c3b-94be-ad2d2bb5041c req-939ab349-b60c-43e2-8e75-dc82b510c8d9 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:55:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-4f867a37-b88f-4c3b-94be-ad2d2bb5041c req-939ab349-b60c-43e2-8e75-dc82b510c8d9 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:55:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-4f867a37-b88f-4c3b-94be-ad2d2bb5041c req-939ab349-b60c-43e2-8e75-dc82b510c8d9 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:55:13 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-4f867a37-b88f-4c3b-94be-ad2d2bb5041c req-939ab349-b60c-43e2-8e75-dc82b510c8d9 service nova] Creating event network-changed:fb3bb75a-7f7c-4611-91bf-313a7f1610b5 for instance 7889054a-8f28-4a2b-95b3-ec64dc421681 on user Apr 11 15:55:13 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-4f867a37-b88f-4c3b-94be-ad2d2bb5041c req-939ab349-b60c-43e2-8e75-dc82b510c8d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035993 Apr 11 15:55:13 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 320/965] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:55:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:55:19 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-4a45b395-7fad-4679-9fee-0518d37b39be req-089cac70-69bd-4814-a165-29afc799adb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7889054a-8f28-4a2b-95b3-ec64dc421681", "name": "network-vif-plugged", "status": "completed", "tag": "fb3bb75a-7f7c-4611-91bf-313a7f1610b5"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:55:19 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-4a45b395-7fad-4679-9fee-0518d37b39be req-089cac70-69bd-4814-a165-29afc799adb6 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:55:19 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-4a45b395-7fad-4679-9fee-0518d37b39be req-089cac70-69bd-4814-a165-29afc799adb6 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:55:19 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-4a45b395-7fad-4679-9fee-0518d37b39be req-089cac70-69bd-4814-a165-29afc799adb6 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:55:19 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-4a45b395-7fad-4679-9fee-0518d37b39be req-089cac70-69bd-4814-a165-29afc799adb6 service nova] Creating event network-vif-plugged:fb3bb75a-7f7c-4611-91bf-313a7f1610b5 for instance 7889054a-8f28-4a2b-95b3-ec64dc421681 on user Apr 11 15:55:19 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-4a45b395-7fad-4679-9fee-0518d37b39be req-089cac70-69bd-4814-a165-29afc799adb6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039542 Apr 11 15:55:19 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 326/966] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:55:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:55:21 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:55:21 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:55:21 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:55:21 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-9b9cd767-7f89-46f6-990d-a12f2ec7fafe req-28d98814-8ba4-4dfe-91f2-f8d2caa26414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7889054a-8f28-4a2b-95b3-ec64dc421681", "name": "network-vif-plugged", "status": "completed", "tag": "fb3bb75a-7f7c-4611-91bf-313a7f1610b5"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:55:21 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-9b9cd767-7f89-46f6-990d-a12f2ec7fafe req-28d98814-8ba4-4dfe-91f2-f8d2caa26414 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:55:21 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-9b9cd767-7f89-46f6-990d-a12f2ec7fafe req-28d98814-8ba4-4dfe-91f2-f8d2caa26414 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:55:21 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-9b9cd767-7f89-46f6-990d-a12f2ec7fafe req-28d98814-8ba4-4dfe-91f2-f8d2caa26414 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:55:21 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-9b9cd767-7f89-46f6-990d-a12f2ec7fafe req-28d98814-8ba4-4dfe-91f2-f8d2caa26414 service nova] Creating event network-vif-plugged:fb3bb75a-7f7c-4611-91bf-313a7f1610b5 for instance 7889054a-8f28-4a2b-95b3-ec64dc421681 on user Apr 11 15:55:21 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-9b9cd767-7f89-46f6-990d-a12f2ec7fafe req-28d98814-8ba4-4dfe-91f2-f8d2caa26414 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040620 Apr 11 15:55:21 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 321/967] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:55:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:55:38 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:55:38 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:55:38 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-1a74080e-6b0d-49fe-9225-cdb4ec760f59 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:55:38 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-1a74080e-6b0d-49fe-9225-cdb4ec760f59 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:55:38 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1a74080e-6b0d-49fe-9225-cdb4ec760f59 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:55:38 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1a74080e-6b0d-49fe-9225-cdb4ec760f59 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:55:38 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1a74080e-6b0d-49fe-9225-cdb4ec760f59 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:55:38 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1a74080e-6b0d-49fe-9225-cdb4ec760f59 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:55:38 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1a74080e-6b0d-49fe-9225-cdb4ec760f59 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:55:38 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1a74080e-6b0d-49fe-9225-cdb4ec760f59 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:55:38 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-1a74080e-6b0d-49fe-9225-cdb4ec760f59 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.097262 Apr 11 15:55:38 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 321/968] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 15:55:38 2023] GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e/os-interface => generated 283 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:55:38 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:55:38 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:55:38 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:55:38 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=4 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:55:39 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:55:39 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:55:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-38de7793-63ae-4d4c-b937-250dce8f3555 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:55:39 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-38de7793-63ae-4d4c-b937-250dce8f3555 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:55:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-81d8d0e4-c4aa-4deb-a355-e37f189e6967 req-cb67ed60-928f-4a34-a212-b7bd34f72e0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d6c5972-e53b-47e9-8f13-7df1ad86020e", "tag": "8fd17bd8-2470-4931-8df3-b1ca41125d39"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:55:39 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-38de7793-63ae-4d4c-b937-250dce8f3555 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:55:39 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-38de7793-63ae-4d4c-b937-250dce8f3555 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:55:39 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-38de7793-63ae-4d4c-b937-250dce8f3555 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:55:39 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-38de7793-63ae-4d4c-b937-250dce8f3555 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:55:39 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-38de7793-63ae-4d4c-b937-250dce8f3555 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:55:39 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-38de7793-63ae-4d4c-b937-250dce8f3555 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:55:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-81d8d0e4-c4aa-4deb-a355-e37f189e6967 req-cb67ed60-928f-4a34-a212-b7bd34f72e0e service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:55:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-81d8d0e4-c4aa-4deb-a355-e37f189e6967 req-cb67ed60-928f-4a34-a212-b7bd34f72e0e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:55:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-81d8d0e4-c4aa-4deb-a355-e37f189e6967 req-cb67ed60-928f-4a34-a212-b7bd34f72e0e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:55:39 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-81d8d0e4-c4aa-4deb-a355-e37f189e6967 req-cb67ed60-928f-4a34-a212-b7bd34f72e0e service nova] Creating event network-changed:8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e on user Apr 11 15:55:39 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-38de7793-63ae-4d4c-b937-250dce8f3555 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e/ips" status: 200 len: 105 microversion: 2.1 time: 0.039083 Apr 11 15:55:39 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 322/969] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 15:55:39 2023] GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e/ips => generated 105 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:55:39 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-81d8d0e4-c4aa-4deb-a355-e37f189e6967 req-cb67ed60-928f-4a34-a212-b7bd34f72e0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103398 Apr 11 15:55:39 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 327/970] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:55:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:55:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b6dc374-b525-44a2-8e35-d4a723ae5915"}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:55:40 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:55:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:55:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:55:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:55:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:55:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:55:40 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:55:40 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291962 Apr 11 15:55:40 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 322/971] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 15:55:40 2023] POST /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:55:47 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-ece5ab05-88fc-4cf4-867f-8f85959069fa tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:55:47 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ece5ab05-88fc-4cf4-867f-8f85959069fa tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:55:47 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ece5ab05-88fc-4cf4-867f-8f85959069fa tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:55:47 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ece5ab05-88fc-4cf4-867f-8f85959069fa tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:55:47 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-ece5ab05-88fc-4cf4-867f-8f85959069fa tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Going to try to stop instance {{(pid=61165) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 11 15:55:47 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-ece5ab05-88fc-4cf4-867f-8f85959069fa tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e/action" status: 202 len: 0 microversion: 2.1 time: 0.108279 Apr 11 15:55:47 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 323/972] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 15:55:47 2023] POST /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:55:47 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-5a1f9f9b-e005-4c4b-8bfb-74044ceb2aa9 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:55:47 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-5a1f9f9b-e005-4c4b-8bfb-74044ceb2aa9 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:55:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-5a1f9f9b-e005-4c4b-8bfb-74044ceb2aa9 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:55:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-5a1f9f9b-e005-4c4b-8bfb-74044ceb2aa9 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:55:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-5a1f9f9b-e005-4c4b-8bfb-74044ceb2aa9 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:55:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-5a1f9f9b-e005-4c4b-8bfb-74044ceb2aa9 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:55:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-5a1f9f9b-e005-4c4b-8bfb-74044ceb2aa9 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:55:47 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-5a1f9f9b-e005-4c4b-8bfb-74044ceb2aa9 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:55:47 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-5a1f9f9b-e005-4c4b-8bfb-74044ceb2aa9 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa87f179b35a4d1db2336802e8f104e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa330c512f045dc8a5946be3563fdcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:55:47 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-5a1f9f9b-e005-4c4b-8bfb-74044ceb2aa9 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e" status: 200 len: 1711 microversion: 2.1 time: 0.171397 Apr 11 15:55:47 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 328/973] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:55:47 2023] GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e => generated 1711 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:55:47 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-a11e05ae-45f3-4b1a-be13-b0ab0628042d req-f3cf633d-f74b-4ab2-9710-d82178ee7566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6c5972-e53b-47e9-8f13-7df1ad86020e", "name": "network-vif-unplugged", "status": "completed", "tag": "8fd17bd8-2470-4931-8df3-b1ca41125d39"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:55:47 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-a11e05ae-45f3-4b1a-be13-b0ab0628042d req-f3cf633d-f74b-4ab2-9710-d82178ee7566 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:55:47 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-a11e05ae-45f3-4b1a-be13-b0ab0628042d req-f3cf633d-f74b-4ab2-9710-d82178ee7566 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:55:47 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-a11e05ae-45f3-4b1a-be13-b0ab0628042d req-f3cf633d-f74b-4ab2-9710-d82178ee7566 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:55:47 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-a11e05ae-45f3-4b1a-be13-b0ab0628042d req-f3cf633d-f74b-4ab2-9710-d82178ee7566 service nova] Creating event network-vif-unplugged:8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e on user Apr 11 15:55:47 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-a11e05ae-45f3-4b1a-be13-b0ab0628042d req-f3cf633d-f74b-4ab2-9710-d82178ee7566 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029230 Apr 11 15:55:47 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 323/974] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:55:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:55:50 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-9d0bafae-0c24-4a14-8815-bf86d940db0a req-38643a7f-365b-4694-b0b7-a16f6c7a1889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6c5972-e53b-47e9-8f13-7df1ad86020e", "name": "network-vif-plugged", "status": "completed", "tag": "8fd17bd8-2470-4931-8df3-b1ca41125d39"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:55:50 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-9d0bafae-0c24-4a14-8815-bf86d940db0a req-38643a7f-365b-4694-b0b7-a16f6c7a1889 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:55:50 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-9d0bafae-0c24-4a14-8815-bf86d940db0a req-38643a7f-365b-4694-b0b7-a16f6c7a1889 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:55:50 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-9d0bafae-0c24-4a14-8815-bf86d940db0a req-38643a7f-365b-4694-b0b7-a16f6c7a1889 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:55:50 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-9d0bafae-0c24-4a14-8815-bf86d940db0a req-38643a7f-365b-4694-b0b7-a16f6c7a1889 service nova] Creating event network-vif-plugged:8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e on user Apr 11 15:55:50 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-9d0bafae-0c24-4a14-8815-bf86d940db0a req-38643a7f-365b-4694-b0b7-a16f6c7a1889 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033404 Apr 11 15:55:50 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 324/975] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:55:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:56:01 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-d17c38a7-150c-4fc0-ab44-67a81d5222ce tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:56:01 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-d17c38a7-150c-4fc0-ab44-67a81d5222ce tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:56:01 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=4 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:56:01 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=8 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:56:01 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d17c38a7-150c-4fc0-ab44-67a81d5222ce tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:56:01 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d17c38a7-150c-4fc0-ab44-67a81d5222ce tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:56:01 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d17c38a7-150c-4fc0-ab44-67a81d5222ce tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:56:01 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d17c38a7-150c-4fc0-ab44-67a81d5222ce tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:56:01 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d17c38a7-150c-4fc0-ab44-67a81d5222ce tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:56:01 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d17c38a7-150c-4fc0-ab44-67a81d5222ce tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:56:02 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-d17c38a7-150c-4fc0-ab44-67a81d5222ce tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2110b74f38642afa560e1c9790d3f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312851c65ba1434691eca0cd2a8cd6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:56:02 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-d17c38a7-150c-4fc0-ab44-67a81d5222ce tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7889054a-8f28-4a2b-95b3-ec64dc421681" status: 200 len: 1442 microversion: 2.1 time: 0.161284 Apr 11 15:56:02 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 329/976] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:56:01 2023] GET /compute/v2.1/servers/7889054a-8f28-4a2b-95b3-ec64dc421681 => generated 1442 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:56:37 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:56:37 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:56:37 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-c1a6a410-a0ba-4feb-8b8f-116d484f5efc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:56:37 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-c1a6a410-a0ba-4feb-8b8f-116d484f5efc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:56:37 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c1a6a410-a0ba-4feb-8b8f-116d484f5efc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:56:37 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c1a6a410-a0ba-4feb-8b8f-116d484f5efc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:56:37 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c1a6a410-a0ba-4feb-8b8f-116d484f5efc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:56:37 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c1a6a410-a0ba-4feb-8b8f-116d484f5efc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:56:37 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c1a6a410-a0ba-4feb-8b8f-116d484f5efc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:56:37 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c1a6a410-a0ba-4feb-8b8f-116d484f5efc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:56:37 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-c1a6a410-a0ba-4feb-8b8f-116d484f5efc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa87f179b35a4d1db2336802e8f104e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa330c512f045dc8a5946be3563fdcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:56:37 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-c1a6a410-a0ba-4feb-8b8f-116d484f5efc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e" status: 200 len: 1688 microversion: 2.1 time: 0.191754 Apr 11 15:56:37 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 324/977] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:56:37 2023] GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e => generated 1688 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:57:02 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:57:02 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:57:02 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-48e4f937-eb27-464b-9fa5-ceaea4cd80af tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:57:02 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-48e4f937-eb27-464b-9fa5-ceaea4cd80af tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:57:02 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-48e4f937-eb27-464b-9fa5-ceaea4cd80af tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:57:02 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-48e4f937-eb27-464b-9fa5-ceaea4cd80af tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:57:02 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-48e4f937-eb27-464b-9fa5-ceaea4cd80af tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:57:02 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-48e4f937-eb27-464b-9fa5-ceaea4cd80af tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:57:02 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-48e4f937-eb27-464b-9fa5-ceaea4cd80af tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:57:02 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-48e4f937-eb27-464b-9fa5-ceaea4cd80af tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:57:02 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-48e4f937-eb27-464b-9fa5-ceaea4cd80af tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2110b74f38642afa560e1c9790d3f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312851c65ba1434691eca0cd2a8cd6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:57:02 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-48e4f937-eb27-464b-9fa5-ceaea4cd80af tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7889054a-8f28-4a2b-95b3-ec64dc421681" status: 200 len: 1442 microversion: 2.1 time: 0.168232 Apr 11 15:57:02 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 325/978] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:57:02 2023] GET /compute/v2.1/servers/7889054a-8f28-4a2b-95b3-ec64dc421681 => generated 1442 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:57:03 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:57:03 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:57:03 user devstack@n-api.service[61167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 15:57:03 user devstack@n-api.service[61167]: Tue Apr 11 15:57:03 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 11 15:57:03 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-44b1e0fe-192c-4aa4-a57d-4af4a5d3c7c7 req-b5f28e12-cba2-4b85-a53f-c0ea2886721a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7889054a-8f28-4a2b-95b3-ec64dc421681", "tag": "fb3bb75a-7f7c-4611-91bf-313a7f1610b5"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:57:03 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-44b1e0fe-192c-4aa4-a57d-4af4a5d3c7c7 req-b5f28e12-cba2-4b85-a53f-c0ea2886721a service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:57:03 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-44b1e0fe-192c-4aa4-a57d-4af4a5d3c7c7 req-b5f28e12-cba2-4b85-a53f-c0ea2886721a service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:57:03 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-44b1e0fe-192c-4aa4-a57d-4af4a5d3c7c7 req-b5f28e12-cba2-4b85-a53f-c0ea2886721a service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:57:03 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-44b1e0fe-192c-4aa4-a57d-4af4a5d3c7c7 req-b5f28e12-cba2-4b85-a53f-c0ea2886721a service nova] Creating event network-changed:fb3bb75a-7f7c-4611-91bf-313a7f1610b5 for instance 7889054a-8f28-4a2b-95b3-ec64dc421681 on user Apr 11 15:57:03 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-44b1e0fe-192c-4aa4-a57d-4af4a5d3c7c7 req-b5f28e12-cba2-4b85-a53f-c0ea2886721a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038605 Apr 11 15:57:03 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 330/979] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:57:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:57:04 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:57:04 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:57:04 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:57:04 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:57:04 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:57:04 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:57:04 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:57:04 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:57:04 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:57:04 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:57:04 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Going to try to terminate instance {{(pid=61166) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:57:04 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7889054a-8f28-4a2b-95b3-ec64dc421681" status: 204 len: 0 microversion: 2.1 time: 0.128291 Apr 11 15:57:04 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 325/980] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:57:04 2023] DELETE /compute/v2.1/servers/7889054a-8f28-4a2b-95b3-ec64dc421681 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:57:04 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-64f811ec-2cb2-4a14-bfe0-44423fce5c91 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:57:04 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-64f811ec-2cb2-4a14-bfe0-44423fce5c91 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:57:04 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-64f811ec-2cb2-4a14-bfe0-44423fce5c91 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:57:04 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-64f811ec-2cb2-4a14-bfe0-44423fce5c91 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:57:04 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-64f811ec-2cb2-4a14-bfe0-44423fce5c91 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:57:04 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-64f811ec-2cb2-4a14-bfe0-44423fce5c91 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:57:04 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-64f811ec-2cb2-4a14-bfe0-44423fce5c91 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:57:04 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-64f811ec-2cb2-4a14-bfe0-44423fce5c91 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:57:04 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-64f811ec-2cb2-4a14-bfe0-44423fce5c91 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2110b74f38642afa560e1c9790d3f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312851c65ba1434691eca0cd2a8cd6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:57:04 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-64f811ec-2cb2-4a14-bfe0-44423fce5c91 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7889054a-8f28-4a2b-95b3-ec64dc421681" status: 200 len: 1566 microversion: 2.1 time: 0.260051 Apr 11 15:57:04 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 326/981] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:57:04 2023] GET /compute/v2.1/servers/7889054a-8f28-4a2b-95b3-ec64dc421681 => generated 1566 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:57:05 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-a7c53fd8-aa33-4db3-b8cd-c35f0b13cb39 req-a7862e71-4461-44f4-9ac1-59892e1bdcba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7889054a-8f28-4a2b-95b3-ec64dc421681", "tag": "fb3bb75a-7f7c-4611-91bf-313a7f1610b5"}, {"server_uuid": "7889054a-8f28-4a2b-95b3-ec64dc421681", "name": "network-vif-unplugged", "status": "completed", "tag": "fb3bb75a-7f7c-4611-91bf-313a7f1610b5"}, {"server_uuid": "7889054a-8f28-4a2b-95b3-ec64dc421681", "name": "network-vif-plugged", "status": "completed", "tag": "fb3bb75a-7f7c-4611-91bf-313a7f1610b5"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:57:05 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-a7c53fd8-aa33-4db3-b8cd-c35f0b13cb39 req-a7862e71-4461-44f4-9ac1-59892e1bdcba service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:57:05 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-a7c53fd8-aa33-4db3-b8cd-c35f0b13cb39 req-a7862e71-4461-44f4-9ac1-59892e1bdcba service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:57:05 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-a7c53fd8-aa33-4db3-b8cd-c35f0b13cb39 req-a7862e71-4461-44f4-9ac1-59892e1bdcba service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:57:05 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-a7c53fd8-aa33-4db3-b8cd-c35f0b13cb39 req-a7862e71-4461-44f4-9ac1-59892e1bdcba service nova] Creating event network-changed:fb3bb75a-7f7c-4611-91bf-313a7f1610b5 for instance 7889054a-8f28-4a2b-95b3-ec64dc421681 on user Apr 11 15:57:05 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-a7c53fd8-aa33-4db3-b8cd-c35f0b13cb39 req-a7862e71-4461-44f4-9ac1-59892e1bdcba service nova] Creating event network-vif-unplugged:fb3bb75a-7f7c-4611-91bf-313a7f1610b5 for instance 7889054a-8f28-4a2b-95b3-ec64dc421681 on user Apr 11 15:57:05 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-a7c53fd8-aa33-4db3-b8cd-c35f0b13cb39 req-a7862e71-4461-44f4-9ac1-59892e1bdcba service nova] Creating event network-vif-plugged:fb3bb75a-7f7c-4611-91bf-313a7f1610b5 for instance 7889054a-8f28-4a2b-95b3-ec64dc421681 on user Apr 11 15:57:05 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-a7c53fd8-aa33-4db3-b8cd-c35f0b13cb39 req-a7862e71-4461-44f4-9ac1-59892e1bdcba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.029901 Apr 11 15:57:05 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 331/982] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:57:05 2023] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:57:06 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-08dba800-0f44-4ad9-b523-ef95ebbc8648 req-7cd0667a-6108-4161-9d6a-bc23c052f804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7889054a-8f28-4a2b-95b3-ec64dc421681", "name": "network-vif-deleted", "tag": "fb3bb75a-7f7c-4611-91bf-313a7f1610b5"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:57:06 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-08dba800-0f44-4ad9-b523-ef95ebbc8648 req-7cd0667a-6108-4161-9d6a-bc23c052f804 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:57:06 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-08dba800-0f44-4ad9-b523-ef95ebbc8648 req-7cd0667a-6108-4161-9d6a-bc23c052f804 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:57:06 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-08dba800-0f44-4ad9-b523-ef95ebbc8648 req-7cd0667a-6108-4161-9d6a-bc23c052f804 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:57:06 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-08dba800-0f44-4ad9-b523-ef95ebbc8648 req-7cd0667a-6108-4161-9d6a-bc23c052f804 service nova] Creating event network-vif-deleted:fb3bb75a-7f7c-4611-91bf-313a7f1610b5 for instance 7889054a-8f28-4a2b-95b3-ec64dc421681 on user Apr 11 15:57:06 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-08dba800-0f44-4ad9-b523-ef95ebbc8648 req-7cd0667a-6108-4161-9d6a-bc23c052f804 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031835 Apr 11 15:57:06 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 326/983] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:57:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:57:38 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:57:38 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=12 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:57:38 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:57:38 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:57:38 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:57:38 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:57:38 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Going to try to start instance {{(pid=61165) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 11 15:57:38 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e/action" status: 202 len: 0 microversion: 2.1 time: 0.078229 Apr 11 15:57:38 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 327/984] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 15:57:38 2023] POST /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:57:38 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=4 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:57:38 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=4 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:57:38 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-4ebb08a1-3a7f-4a77-9431-abb59f405a3a tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:57:38 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-4ebb08a1-3a7f-4a77-9431-abb59f405a3a tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:57:38 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4ebb08a1-3a7f-4a77-9431-abb59f405a3a tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:57:38 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4ebb08a1-3a7f-4a77-9431-abb59f405a3a tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:57:38 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4ebb08a1-3a7f-4a77-9431-abb59f405a3a tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:57:38 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4ebb08a1-3a7f-4a77-9431-abb59f405a3a tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:57:38 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4ebb08a1-3a7f-4a77-9431-abb59f405a3a tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:57:38 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4ebb08a1-3a7f-4a77-9431-abb59f405a3a tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:57:38 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-4ebb08a1-3a7f-4a77-9431-abb59f405a3a tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa87f179b35a4d1db2336802e8f104e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa330c512f045dc8a5946be3563fdcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:57:38 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-4ebb08a1-3a7f-4a77-9431-abb59f405a3a tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e" status: 200 len: 1697 microversion: 2.1 time: 0.284096 Apr 11 15:57:38 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 332/985] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:57:38 2023] GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e => generated 1697 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:57:42 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:57:42 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:57:42 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-fb800723-d1bf-42e4-a338-679c783a502f req-8df606d8-43d7-45eb-afeb-bbfee4cbba80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6c5972-e53b-47e9-8f13-7df1ad86020e", "name": "network-vif-plugged", "status": "completed", "tag": "8fd17bd8-2470-4931-8df3-b1ca41125d39"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:57:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-fb800723-d1bf-42e4-a338-679c783a502f req-8df606d8-43d7-45eb-afeb-bbfee4cbba80 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:57:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-fb800723-d1bf-42e4-a338-679c783a502f req-8df606d8-43d7-45eb-afeb-bbfee4cbba80 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:57:42 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-fb800723-d1bf-42e4-a338-679c783a502f req-8df606d8-43d7-45eb-afeb-bbfee4cbba80 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:57:42 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-fb800723-d1bf-42e4-a338-679c783a502f req-8df606d8-43d7-45eb-afeb-bbfee4cbba80 service nova] Creating event network-vif-plugged:8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e on user Apr 11 15:57:42 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-fb800723-d1bf-42e4-a338-679c783a502f req-8df606d8-43d7-45eb-afeb-bbfee4cbba80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044508 Apr 11 15:57:42 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 327/986] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:57:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:57:44 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-0a60b560-6947-403a-87fe-0f2496fe7d67 req-ff1cb218-1c0e-423b-a682-f116f4570363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6c5972-e53b-47e9-8f13-7df1ad86020e", "name": "network-vif-plugged", "status": "completed", "tag": "8fd17bd8-2470-4931-8df3-b1ca41125d39"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:57:44 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-0a60b560-6947-403a-87fe-0f2496fe7d67 req-ff1cb218-1c0e-423b-a682-f116f4570363 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:57:44 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-0a60b560-6947-403a-87fe-0f2496fe7d67 req-ff1cb218-1c0e-423b-a682-f116f4570363 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:57:44 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-0a60b560-6947-403a-87fe-0f2496fe7d67 req-ff1cb218-1c0e-423b-a682-f116f4570363 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:57:44 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-0a60b560-6947-403a-87fe-0f2496fe7d67 req-ff1cb218-1c0e-423b-a682-f116f4570363 service nova] Creating event network-vif-plugged:8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e on user Apr 11 15:57:44 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-0a60b560-6947-403a-87fe-0f2496fe7d67 req-ff1cb218-1c0e-423b-a682-f116f4570363 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031984 Apr 11 15:57:44 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 328/987] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:57:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:57:54 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-6f4033ed-6c66-4fac-bc2b-aaa4e7e4ae7d tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:57:54 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-6f4033ed-6c66-4fac-bc2b-aaa4e7e4ae7d tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:57:54 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:57:54 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:57:54 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-6f4033ed-6c66-4fac-bc2b-aaa4e7e4ae7d tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:57:54 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-6f4033ed-6c66-4fac-bc2b-aaa4e7e4ae7d tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:57:54 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-6f4033ed-6c66-4fac-bc2b-aaa4e7e4ae7d tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:57:54 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-6f4033ed-6c66-4fac-bc2b-aaa4e7e4ae7d tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:57:54 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-6f4033ed-6c66-4fac-bc2b-aaa4e7e4ae7d tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:57:54 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-6f4033ed-6c66-4fac-bc2b-aaa4e7e4ae7d tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:57:54 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-6f4033ed-6c66-4fac-bc2b-aaa4e7e4ae7d tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] HTTP exception thrown: Instance 7889054a-8f28-4a2b-95b3-ec64dc421681 could not be found. Apr 11 15:57:54 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-6f4033ed-6c66-4fac-bc2b-aaa4e7e4ae7d tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Request method failure captured: Apr 11 15:57:54 user devstack@n-api.service[61167]: request: GET /compute/v2.1/servers/7889054a-8f28-4a2b-95b3-ec64dc421681 HTTP/1.1 Apr 11 15:57:54 user devstack@n-api.service[61167]: Accept: application/json Apr 11 15:57:54 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 15:57:54 user devstack@n-api.service[61167]: Connection: close Apr 11 15:57:54 user devstack@n-api.service[61167]: Content-Length: 0 Apr 11 15:57:54 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 15:57:54 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 15:57:54 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 15:57:54 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 15:57:54 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNX_MfySgeWQGetehYkoHqYg1G1945hTNCEJ0iZ6MzpnT3yZAJa_LjZxGoo77mYeoWNM22txPKHxqCAJQHMF1JaEqPSco0vUdydRE47pwKZna0AOIEDnSU3nak09PN7xX11kpifNQbUB7HIx3dygnGm9WJh4EQWIeaVGEcb-QhV49Vog Apr 11 15:57:54 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 15:57:54 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 15:57:54 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 15:57:54 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 15:57:54 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 15:57:54 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 15:57:54 user devstack@n-api.service[61167]: X-Project-Id: 312851c65ba1434691eca0cd2a8cd6d2 Apr 11 15:57:54 user devstack@n-api.service[61167]: X-Project-Name: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:57:54 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 15:57:54 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 15:57:54 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:57:54 user devstack@n-api.service[61167]: X-Tenant: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:57:54 user devstack@n-api.service[61167]: X-Tenant-Id: 312851c65ba1434691eca0cd2a8cd6d2 Apr 11 15:57:54 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:57:54 user devstack@n-api.service[61167]: X-User: tempest-TestVolumeBootPattern-1933582504-project-member Apr 11 15:57:54 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 15:57:54 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 15:57:54 user devstack@n-api.service[61167]: X-User-Id: c2110b74f38642afa560e1c9790d3f81 Apr 11 15:57:54 user devstack@n-api.service[61167]: X-User-Name: tempest-TestVolumeBootPattern-1933582504-project-member Apr 11 15:57:54 user devstack@n-api.service[61167]: method: > Apr 11 15:57:54 user devstack@n-api.service[61167]: exception: Instance 7889054a-8f28-4a2b-95b3-ec64dc421681 could not be found. Apr 11 15:57:54 user devstack@n-api.service[61167]: action_args: {'id': '7889054a-8f28-4a2b-95b3-ec64dc421681'} Apr 11 15:57:54 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7889054a-8f28-4a2b-95b3-ec64dc421681 could not be found. Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7889054a-8f28-4a2b-95b3-ec64dc421681 could not be found. Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7889054a-8f28-4a2b-95b3-ec64dc421681 could not be found. Apr 11 15:57:54 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:57:54 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-6f4033ed-6c66-4fac-bc2b-aaa4e7e4ae7d tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Returning 404 to user: Instance 7889054a-8f28-4a2b-95b3-ec64dc421681 could not be found. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:57:54 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-6f4033ed-6c66-4fac-bc2b-aaa4e7e4ae7d tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7889054a-8f28-4a2b-95b3-ec64dc421681" status: 404 len: 111 microversion: 2.1 time: 0.033300 Apr 11 15:57:54 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 333/988] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:57:54 2023] GET /compute/v2.1/servers/7889054a-8f28-4a2b-95b3-ec64dc421681 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:57:57 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:57:57 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:57:57 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:57:57 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-c5a0bc54-d307-4a8d-a13f-16a56962a1ff req-6b3bb145-b095-4aec-9bad-cc68824f07f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56fbe043-133f-4e43-b9db-8ed02a3ed2af", "tag": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:57:57 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:57:57 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:57:57 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:57:57 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:57:57 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-c5a0bc54-d307-4a8d-a13f-16a56962a1ff req-6b3bb145-b095-4aec-9bad-cc68824f07f7 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:57:57 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:57:57 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-c5a0bc54-d307-4a8d-a13f-16a56962a1ff req-6b3bb145-b095-4aec-9bad-cc68824f07f7 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:57:57 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-c5a0bc54-d307-4a8d-a13f-16a56962a1ff req-6b3bb145-b095-4aec-9bad-cc68824f07f7 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:57:57 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:57:57 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:57:57 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:57:57 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-c5a0bc54-d307-4a8d-a13f-16a56962a1ff req-6b3bb145-b095-4aec-9bad-cc68824f07f7 service nova] Creating event network-changed:77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b for instance 56fbe043-133f-4e43-b9db-8ed02a3ed2af on user Apr 11 15:57:57 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-c5a0bc54-d307-4a8d-a13f-16a56962a1ff req-6b3bb145-b095-4aec-9bad-cc68824f07f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041313 Apr 11 15:57:57 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 329/989] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:57:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:57:57 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Going to try to terminate instance {{(pid=61166) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 15:57:57 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/56fbe043-133f-4e43-b9db-8ed02a3ed2af" status: 204 len: 0 microversion: 2.1 time: 0.128696 Apr 11 15:57:57 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 328/990] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:57:57 2023] DELETE /compute/v2.1/servers/56fbe043-133f-4e43-b9db-8ed02a3ed2af => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 15:57:57 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-c202902c-c875-4a7e-802b-63ee4c655fdd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:57:57 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-c202902c-c875-4a7e-802b-63ee4c655fdd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:57:57 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c202902c-c875-4a7e-802b-63ee4c655fdd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:57:57 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c202902c-c875-4a7e-802b-63ee4c655fdd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:57:57 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c202902c-c875-4a7e-802b-63ee4c655fdd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:57:57 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c202902c-c875-4a7e-802b-63ee4c655fdd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:57:57 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c202902c-c875-4a7e-802b-63ee4c655fdd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:57:57 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c202902c-c875-4a7e-802b-63ee4c655fdd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:57:58 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-c202902c-c875-4a7e-802b-63ee4c655fdd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2110b74f38642afa560e1c9790d3f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312851c65ba1434691eca0cd2a8cd6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:57:58 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-c202902c-c875-4a7e-802b-63ee4c655fdd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56fbe043-133f-4e43-b9db-8ed02a3ed2af" status: 200 len: 1565 microversion: 2.1 time: 0.197004 Apr 11 15:57:58 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 334/991] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:57:57 2023] GET /compute/v2.1/servers/56fbe043-133f-4e43-b9db-8ed02a3ed2af => generated 1565 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:57:58 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-e420b368-9957-40fb-854c-e7d7d6591638 req-0f3e8f54-a551-4ade-bcda-e3290594eb82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56fbe043-133f-4e43-b9db-8ed02a3ed2af", "name": "network-vif-unplugged", "status": "completed", "tag": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:57:58 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-e420b368-9957-40fb-854c-e7d7d6591638 req-0f3e8f54-a551-4ade-bcda-e3290594eb82 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:57:58 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-e420b368-9957-40fb-854c-e7d7d6591638 req-0f3e8f54-a551-4ade-bcda-e3290594eb82 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:57:58 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-e420b368-9957-40fb-854c-e7d7d6591638 req-0f3e8f54-a551-4ade-bcda-e3290594eb82 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:57:58 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-e420b368-9957-40fb-854c-e7d7d6591638 req-0f3e8f54-a551-4ade-bcda-e3290594eb82 service nova] Creating event network-vif-unplugged:77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b for instance 56fbe043-133f-4e43-b9db-8ed02a3ed2af on user Apr 11 15:57:58 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-e420b368-9957-40fb-854c-e7d7d6591638 req-0f3e8f54-a551-4ade-bcda-e3290594eb82 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029782 Apr 11 15:57:58 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 330/992] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:57:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:58:00 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-d8c23a53-dfbe-4237-823d-cf234b5f9c83 req-c551ab54-5fc2-4647-b471-170ca559eaa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56fbe043-133f-4e43-b9db-8ed02a3ed2af", "name": "network-vif-plugged", "status": "completed", "tag": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b"}, {"server_uuid": "56fbe043-133f-4e43-b9db-8ed02a3ed2af", "name": "network-vif-deleted", "tag": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:58:00 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-d8c23a53-dfbe-4237-823d-cf234b5f9c83 req-c551ab54-5fc2-4647-b471-170ca559eaa7 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:58:00 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-d8c23a53-dfbe-4237-823d-cf234b5f9c83 req-c551ab54-5fc2-4647-b471-170ca559eaa7 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:58:00 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-d8c23a53-dfbe-4237-823d-cf234b5f9c83 req-c551ab54-5fc2-4647-b471-170ca559eaa7 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:58:00 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-d8c23a53-dfbe-4237-823d-cf234b5f9c83 req-c551ab54-5fc2-4647-b471-170ca559eaa7 service nova] Creating event network-vif-plugged:77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b for instance 56fbe043-133f-4e43-b9db-8ed02a3ed2af on user Apr 11 15:58:00 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-d8c23a53-dfbe-4237-823d-cf234b5f9c83 req-c551ab54-5fc2-4647-b471-170ca559eaa7 service nova] Creating event network-vif-deleted:77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b for instance 56fbe043-133f-4e43-b9db-8ed02a3ed2af on user Apr 11 15:58:00 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-d8c23a53-dfbe-4237-823d-cf234b5f9c83 req-c551ab54-5fc2-4647-b471-170ca559eaa7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029019 Apr 11 15:58:00 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 329/993] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:58:00 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:58:28 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-ccd97a18-6f3d-42bc-8ef3-553511a0bb94 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:58:28 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-ccd97a18-6f3d-42bc-8ef3-553511a0bb94 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:58:28 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=4 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:58:28 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=8 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:58:28 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ccd97a18-6f3d-42bc-8ef3-553511a0bb94 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:58:28 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ccd97a18-6f3d-42bc-8ef3-553511a0bb94 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:58:28 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ccd97a18-6f3d-42bc-8ef3-553511a0bb94 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:58:28 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ccd97a18-6f3d-42bc-8ef3-553511a0bb94 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:58:28 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ccd97a18-6f3d-42bc-8ef3-553511a0bb94 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:58:28 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ccd97a18-6f3d-42bc-8ef3-553511a0bb94 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:58:28 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-ccd97a18-6f3d-42bc-8ef3-553511a0bb94 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa87f179b35a4d1db2336802e8f104e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa330c512f045dc8a5946be3563fdcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:58:28 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-ccd97a18-6f3d-42bc-8ef3-553511a0bb94 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e" status: 200 len: 1701 microversion: 2.1 time: 0.316748 Apr 11 15:58:28 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 335/994] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:58:28 2023] GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e => generated 1701 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:58:48 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:58:48 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:58:48 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-afe035dd-9cfa-4440-98d6-d988430deb08 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:58:48 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-afe035dd-9cfa-4440-98d6-d988430deb08 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:58:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-afe035dd-9cfa-4440-98d6-d988430deb08 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:58:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-afe035dd-9cfa-4440-98d6-d988430deb08 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:58:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-afe035dd-9cfa-4440-98d6-d988430deb08 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:58:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-afe035dd-9cfa-4440-98d6-d988430deb08 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:58:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-afe035dd-9cfa-4440-98d6-d988430deb08 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:58:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-afe035dd-9cfa-4440-98d6-d988430deb08 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:58:48 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-afe035dd-9cfa-4440-98d6-d988430deb08 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] HTTP exception thrown: Instance 56fbe043-133f-4e43-b9db-8ed02a3ed2af could not be found. Apr 11 15:58:48 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-afe035dd-9cfa-4440-98d6-d988430deb08 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Request method failure captured: Apr 11 15:58:48 user devstack@n-api.service[61165]: request: GET /compute/v2.1/servers/56fbe043-133f-4e43-b9db-8ed02a3ed2af HTTP/1.1 Apr 11 15:58:48 user devstack@n-api.service[61165]: Accept: application/json Apr 11 15:58:48 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 15:58:48 user devstack@n-api.service[61165]: Connection: close Apr 11 15:58:48 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 15:58:48 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 15:58:48 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 15:58:48 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 15:58:48 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 15:58:48 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNX_MfySgeWQGetehYkoHqYg1G1945hTNCEJ0iZ6MzpnT3yZAJa_LjZxGoo77mYeoWNM22txPKHxqCAJQHMF1JaEqPSco0vUdydRE47pwKZna0AOIEDnSU3nak09PN7xX11kpifNQbUB7HIx3dygnGm9WJh4EQWIeaVGEcb-QhV49Vog Apr 11 15:58:48 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 15:58:48 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 15:58:48 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 15:58:48 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 15:58:48 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 15:58:48 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 15:58:48 user devstack@n-api.service[61165]: X-Project-Id: 312851c65ba1434691eca0cd2a8cd6d2 Apr 11 15:58:48 user devstack@n-api.service[61165]: X-Project-Name: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:58:48 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 15:58:48 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 15:58:48 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:58:48 user devstack@n-api.service[61165]: X-Tenant: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:58:48 user devstack@n-api.service[61165]: X-Tenant-Id: 312851c65ba1434691eca0cd2a8cd6d2 Apr 11 15:58:48 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:58:48 user devstack@n-api.service[61165]: X-User: tempest-TestVolumeBootPattern-1933582504-project-member Apr 11 15:58:48 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 15:58:48 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 15:58:48 user devstack@n-api.service[61165]: X-User-Id: c2110b74f38642afa560e1c9790d3f81 Apr 11 15:58:48 user devstack@n-api.service[61165]: X-User-Name: tempest-TestVolumeBootPattern-1933582504-project-member Apr 11 15:58:48 user devstack@n-api.service[61165]: method: > Apr 11 15:58:48 user devstack@n-api.service[61165]: exception: Instance 56fbe043-133f-4e43-b9db-8ed02a3ed2af could not be found. Apr 11 15:58:48 user devstack@n-api.service[61165]: action_args: {'id': '56fbe043-133f-4e43-b9db-8ed02a3ed2af'} Apr 11 15:58:48 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56fbe043-133f-4e43-b9db-8ed02a3ed2af could not be found. Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56fbe043-133f-4e43-b9db-8ed02a3ed2af could not be found. Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56fbe043-133f-4e43-b9db-8ed02a3ed2af could not be found. Apr 11 15:58:48 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 15:58:48 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-afe035dd-9cfa-4440-98d6-d988430deb08 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Returning 404 to user: Instance 56fbe043-133f-4e43-b9db-8ed02a3ed2af could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:58:48 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-afe035dd-9cfa-4440-98d6-d988430deb08 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56fbe043-133f-4e43-b9db-8ed02a3ed2af" status: 404 len: 111 microversion: 2.1 time: 0.091464 Apr 11 15:58:48 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 331/995] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:58:48 2023] GET /compute/v2.1/servers/56fbe043-133f-4e43-b9db-8ed02a3ed2af => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:58:48 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:58:48 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:58:48 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-99d8a963-a574-405e-8d40-3d71d57c9457 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:58:48 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-99d8a963-a574-405e-8d40-3d71d57c9457 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:58:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-99d8a963-a574-405e-8d40-3d71d57c9457 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:58:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-99d8a963-a574-405e-8d40-3d71d57c9457 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:58:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-99d8a963-a574-405e-8d40-3d71d57c9457 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:58:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-99d8a963-a574-405e-8d40-3d71d57c9457 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:58:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-99d8a963-a574-405e-8d40-3d71d57c9457 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:58:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-99d8a963-a574-405e-8d40-3d71d57c9457 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:58:48 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-99d8a963-a574-405e-8d40-3d71d57c9457 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] HTTP exception thrown: Instance 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 could not be found. Apr 11 15:58:48 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-99d8a963-a574-405e-8d40-3d71d57c9457 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Request method failure captured: Apr 11 15:58:48 user devstack@n-api.service[61166]: request: DELETE /compute/v2.1/servers/507b2cc1-0a6c-4ae2-a254-3a991f495fe3 HTTP/1.1 Apr 11 15:58:48 user devstack@n-api.service[61166]: Accept: application/json Apr 11 15:58:48 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 15:58:48 user devstack@n-api.service[61166]: Connection: close Apr 11 15:58:48 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 15:58:48 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 15:58:48 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 15:58:48 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 15:58:48 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 15:58:48 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNX_MfySgeWQGetehYkoHqYg1G1945hTNCEJ0iZ6MzpnT3yZAJa_LjZxGoo77mYeoWNM22txPKHxqCAJQHMF1JaEqPSco0vUdydRE47pwKZna0AOIEDnSU3nak09PN7xX11kpifNQbUB7HIx3dygnGm9WJh4EQWIeaVGEcb-QhV49Vog Apr 11 15:58:48 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 15:58:48 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 15:58:48 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 15:58:48 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 15:58:48 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 15:58:48 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 15:58:48 user devstack@n-api.service[61166]: X-Project-Id: 312851c65ba1434691eca0cd2a8cd6d2 Apr 11 15:58:48 user devstack@n-api.service[61166]: X-Project-Name: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:58:48 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 15:58:48 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 15:58:48 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:58:48 user devstack@n-api.service[61166]: X-Tenant: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:58:48 user devstack@n-api.service[61166]: X-Tenant-Id: 312851c65ba1434691eca0cd2a8cd6d2 Apr 11 15:58:48 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:58:48 user devstack@n-api.service[61166]: X-User: tempest-TestVolumeBootPattern-1933582504-project-member Apr 11 15:58:48 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 15:58:48 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 15:58:48 user devstack@n-api.service[61166]: X-User-Id: c2110b74f38642afa560e1c9790d3f81 Apr 11 15:58:48 user devstack@n-api.service[61166]: X-User-Name: tempest-TestVolumeBootPattern-1933582504-project-member Apr 11 15:58:48 user devstack@n-api.service[61166]: method: > Apr 11 15:58:48 user devstack@n-api.service[61166]: exception: Instance 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 could not be found. Apr 11 15:58:48 user devstack@n-api.service[61166]: action_args: {'id': '507b2cc1-0a6c-4ae2-a254-3a991f495fe3'} Apr 11 15:58:48 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 could not be found. Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 could not be found. Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 could not be found. Apr 11 15:58:48 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 15:58:48 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-99d8a963-a574-405e-8d40-3d71d57c9457 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Returning 404 to user: Instance 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 could not be found. {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:58:48 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-99d8a963-a574-405e-8d40-3d71d57c9457 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/507b2cc1-0a6c-4ae2-a254-3a991f495fe3" status: 404 len: 111 microversion: 2.1 time: 0.037131 Apr 11 15:58:48 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 330/996] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 15:58:48 2023] DELETE /compute/v2.1/servers/507b2cc1-0a6c-4ae2-a254-3a991f495fe3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:58:48 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-d2dafafd-4bbf-47f2-8161-a311c79d2ef3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:58:48 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-d2dafafd-4bbf-47f2-8161-a311c79d2ef3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:58:48 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:58:48 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:58:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d2dafafd-4bbf-47f2-8161-a311c79d2ef3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:58:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d2dafafd-4bbf-47f2-8161-a311c79d2ef3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:58:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d2dafafd-4bbf-47f2-8161-a311c79d2ef3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:58:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d2dafafd-4bbf-47f2-8161-a311c79d2ef3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:58:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d2dafafd-4bbf-47f2-8161-a311c79d2ef3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:58:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d2dafafd-4bbf-47f2-8161-a311c79d2ef3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:58:48 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-d2dafafd-4bbf-47f2-8161-a311c79d2ef3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] HTTP exception thrown: Instance 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 could not be found. Apr 11 15:58:48 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-d2dafafd-4bbf-47f2-8161-a311c79d2ef3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Request method failure captured: Apr 11 15:58:48 user devstack@n-api.service[61167]: request: GET /compute/v2.1/servers/507b2cc1-0a6c-4ae2-a254-3a991f495fe3 HTTP/1.1 Apr 11 15:58:48 user devstack@n-api.service[61167]: Accept: application/json Apr 11 15:58:48 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 15:58:48 user devstack@n-api.service[61167]: Connection: close Apr 11 15:58:48 user devstack@n-api.service[61167]: Content-Length: 0 Apr 11 15:58:48 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 15:58:48 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 15:58:48 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 15:58:48 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 15:58:48 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNX_MfySgeWQGetehYkoHqYg1G1945hTNCEJ0iZ6MzpnT3yZAJa_LjZxGoo77mYeoWNM22txPKHxqCAJQHMF1JaEqPSco0vUdydRE47pwKZna0AOIEDnSU3nak09PN7xX11kpifNQbUB7HIx3dygnGm9WJh4EQWIeaVGEcb-QhV49Vog Apr 11 15:58:48 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 15:58:48 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 15:58:48 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 15:58:48 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 15:58:48 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 15:58:48 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 15:58:48 user devstack@n-api.service[61167]: X-Project-Id: 312851c65ba1434691eca0cd2a8cd6d2 Apr 11 15:58:48 user devstack@n-api.service[61167]: X-Project-Name: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:58:48 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 15:58:48 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 15:58:48 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/312851c65ba1434691eca0cd2a8cd6d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 15:58:48 user devstack@n-api.service[61167]: X-Tenant: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:58:48 user devstack@n-api.service[61167]: X-Tenant-Id: 312851c65ba1434691eca0cd2a8cd6d2 Apr 11 15:58:48 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-TestVolumeBootPattern-1933582504 Apr 11 15:58:48 user devstack@n-api.service[61167]: X-User: tempest-TestVolumeBootPattern-1933582504-project-member Apr 11 15:58:48 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 15:58:48 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 15:58:48 user devstack@n-api.service[61167]: X-User-Id: c2110b74f38642afa560e1c9790d3f81 Apr 11 15:58:48 user devstack@n-api.service[61167]: X-User-Name: tempest-TestVolumeBootPattern-1933582504-project-member Apr 11 15:58:48 user devstack@n-api.service[61167]: method: > Apr 11 15:58:48 user devstack@n-api.service[61167]: exception: Instance 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 could not be found. Apr 11 15:58:48 user devstack@n-api.service[61167]: action_args: {'id': '507b2cc1-0a6c-4ae2-a254-3a991f495fe3'} Apr 11 15:58:48 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 could not be found. Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 could not be found. Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 could not be found. Apr 11 15:58:48 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 15:58:48 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-d2dafafd-4bbf-47f2-8161-a311c79d2ef3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Returning 404 to user: Instance 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 could not be found. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 15:58:48 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-d2dafafd-4bbf-47f2-8161-a311c79d2ef3 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/507b2cc1-0a6c-4ae2-a254-3a991f495fe3" status: 404 len: 111 microversion: 2.1 time: 0.047995 Apr 11 15:58:48 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 336/997] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:58:48 2023] GET /compute/v2.1/servers/507b2cc1-0a6c-4ae2-a254-3a991f495fe3 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 15:58:50 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-b6cff21b-ac1c-46ce-91f6-5d08d64cec62 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Calling method '.version_select at 0x7f4c2ecab250>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:58:50 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-b6cff21b-ac1c-46ce-91f6-5d08d64cec62 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1289860889" status: 202 len: 0 microversion: 2.1 time: 0.023806 Apr 11 15:58:50 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 332/998] 10.0.0.210 () {62 vars in 1340 bytes} [Tue Apr 11 15:58:50 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1289860889 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:59:29 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:59:29 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:59:29 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:59:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:59:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:59:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:59:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:59:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:59:29 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:59:29 user devstack@n-api.service[61166]: DEBUG nova.objects.instance [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'services' on Instance uuid 0d6c5972-e53b-47e9-8f13-7df1ad86020e {{(pid=61166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 15:59:29 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e/os-volume_attachments/0b6dc374-b525-44a2-8e35-d4a723ae5915" status: 202 len: 0 microversion: 2.1 time: 0.487843 Apr 11 15:59:29 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 331/999] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 15:59:29 2023] DELETE /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e/os-volume_attachments/0b6dc374-b525-44a2-8e35-d4a723ae5915 => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:59:31 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-18bb0ae5-261a-4d34-8967-e64b9b0a0c0e tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:59:31 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:59:31 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:59:31 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-18bb0ae5-261a-4d34-8967-e64b9b0a0c0e tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:59:31 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-18bb0ae5-261a-4d34-8967-e64b9b0a0c0e tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:59:31 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-18bb0ae5-261a-4d34-8967-e64b9b0a0c0e tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:59:31 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-18bb0ae5-261a-4d34-8967-e64b9b0a0c0e tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Going to try to stop instance {{(pid=61167) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 11 15:59:31 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-18bb0ae5-261a-4d34-8967-e64b9b0a0c0e tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e/action" status: 202 len: 0 microversion: 2.1 time: 0.111194 Apr 11 15:59:31 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 337/1000] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 15:59:31 2023] POST /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 15:59:31 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:59:31 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 15:59:31 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-a79b2b45-2e7a-4742-8d67-c836568ed561 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 15:59:31 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-a79b2b45-2e7a-4742-8d67-c836568ed561 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 15:59:31 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-a79b2b45-2e7a-4742-8d67-c836568ed561 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:59:31 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-a79b2b45-2e7a-4742-8d67-c836568ed561 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:59:31 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-a79b2b45-2e7a-4742-8d67-c836568ed561 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:59:31 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-a79b2b45-2e7a-4742-8d67-c836568ed561 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:59:31 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-a79b2b45-2e7a-4742-8d67-c836568ed561 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:59:31 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-a79b2b45-2e7a-4742-8d67-c836568ed561 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:59:32 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-a79b2b45-2e7a-4742-8d67-c836568ed561 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa87f179b35a4d1db2336802e8f104e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa330c512f045dc8a5946be3563fdcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 15:59:32 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-a79b2b45-2e7a-4742-8d67-c836568ed561 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e" status: 200 len: 1665 microversion: 2.1 time: 0.309627 Apr 11 15:59:32 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 333/1001] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 15:59:31 2023] GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e => generated 1665 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 15:59:32 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-7c394efa-f29f-4ddc-83c9-c5db7dcb9ca8 req-b39ebdfe-17d3-4b7d-91e2-eb4763c5c705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6c5972-e53b-47e9-8f13-7df1ad86020e", "name": "network-vif-unplugged", "status": "completed", "tag": "8fd17bd8-2470-4931-8df3-b1ca41125d39"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:59:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-7c394efa-f29f-4ddc-83c9-c5db7dcb9ca8 req-b39ebdfe-17d3-4b7d-91e2-eb4763c5c705 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:59:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-7c394efa-f29f-4ddc-83c9-c5db7dcb9ca8 req-b39ebdfe-17d3-4b7d-91e2-eb4763c5c705 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:59:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-7c394efa-f29f-4ddc-83c9-c5db7dcb9ca8 req-b39ebdfe-17d3-4b7d-91e2-eb4763c5c705 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:59:32 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-7c394efa-f29f-4ddc-83c9-c5db7dcb9ca8 req-b39ebdfe-17d3-4b7d-91e2-eb4763c5c705 service nova] Creating event network-vif-unplugged:8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e on user Apr 11 15:59:32 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-7c394efa-f29f-4ddc-83c9-c5db7dcb9ca8 req-b39ebdfe-17d3-4b7d-91e2-eb4763c5c705 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087516 Apr 11 15:59:32 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 332/1002] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:59:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 15:59:34 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-26de82d3-d5bf-4bdb-9dab-e3788edd322b req-213116f9-af9c-4348-bc03-cc30b9404c62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6c5972-e53b-47e9-8f13-7df1ad86020e", "name": "network-vif-plugged", "status": "completed", "tag": "8fd17bd8-2470-4931-8df3-b1ca41125d39"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 15:59:34 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-26de82d3-d5bf-4bdb-9dab-e3788edd322b req-213116f9-af9c-4348-bc03-cc30b9404c62 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 15:59:34 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-26de82d3-d5bf-4bdb-9dab-e3788edd322b req-213116f9-af9c-4348-bc03-cc30b9404c62 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 15:59:34 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-26de82d3-d5bf-4bdb-9dab-e3788edd322b req-213116f9-af9c-4348-bc03-cc30b9404c62 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 15:59:34 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-26de82d3-d5bf-4bdb-9dab-e3788edd322b req-213116f9-af9c-4348-bc03-cc30b9404c62 service nova] Creating event network-vif-plugged:8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e on user Apr 11 15:59:34 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-26de82d3-d5bf-4bdb-9dab-e3788edd322b req-213116f9-af9c-4348-bc03-cc30b9404c62 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028692 Apr 11 15:59:34 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 338/1003] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 15:59:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:00:22 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-349a4cc4-3974-4296-a224-a9ba491921fc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:00:22 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-349a4cc4-3974-4296-a224-a9ba491921fc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:00:22 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:00:22 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:00:22 user devstack@n-api.service[61165]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:00:22 user devstack@n-api.service[61165]: Tue Apr 11 16:00:22 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e (ip 10.0.0.210) !!! Apr 11 16:00:22 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-349a4cc4-3974-4296-a224-a9ba491921fc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:00:22 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-349a4cc4-3974-4296-a224-a9ba491921fc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:00:22 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-349a4cc4-3974-4296-a224-a9ba491921fc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:00:22 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-349a4cc4-3974-4296-a224-a9ba491921fc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:00:22 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-349a4cc4-3974-4296-a224-a9ba491921fc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:00:22 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-349a4cc4-3974-4296-a224-a9ba491921fc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:00:22 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-349a4cc4-3974-4296-a224-a9ba491921fc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa87f179b35a4d1db2336802e8f104e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa330c512f045dc8a5946be3563fdcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 16:00:22 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-349a4cc4-3974-4296-a224-a9ba491921fc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e" status: 200 len: 1642 microversion: 2.1 time: 0.252803 Apr 11 16:00:22 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 334/1004] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:00:22 2023] GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e => generated 1642 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:01:22 user devstack@n-api.service[61166]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c34c4012-5e24-4363-ac5f-17d8dd71dc66] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 11 16:01:22 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:01:22 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:01:22 user devstack@n-api.service[61166]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:01:22 user devstack@n-api.service[61166]: Tue Apr 11 16:01:22 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e/action (ip 10.0.0.210) !!! Apr 11 16:01:22 user devstack@n-api.service[61166]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:01:22 user devstack@n-api.service[61166]: Tue Apr 11 16:01:22 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e/action (ip 10.0.0.210) !!! Apr 11 16:01:22 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:01:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:01:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:01:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:01:22 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Going to try to start instance {{(pid=61166) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 11 16:01:22 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e/action" status: 202 len: 0 microversion: 2.1 time: 0.161793 Apr 11 16:01:22 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 333/1005] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 16:01:22 2023] POST /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:01:22 user devstack@n-api.service[61167]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f5e3bdb2-c95f-470f-b3a7-1902314e275b] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 11 16:01:22 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=4 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:01:22 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:01:22 user devstack@n-api.service[61167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:01:22 user devstack@n-api.service[61167]: Tue Apr 11 16:01:22 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e (ip 10.0.0.210) !!! Apr 11 16:01:22 user devstack@n-api.service[61167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:01:22 user devstack@n-api.service[61167]: Tue Apr 11 16:01:22 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e (ip 10.0.0.210) !!! Apr 11 16:01:22 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-4593e40b-6b71-4910-8a07-9dee8fa42a94 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:01:22 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-4593e40b-6b71-4910-8a07-9dee8fa42a94 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:01:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4593e40b-6b71-4910-8a07-9dee8fa42a94 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:01:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4593e40b-6b71-4910-8a07-9dee8fa42a94 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:01:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4593e40b-6b71-4910-8a07-9dee8fa42a94 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:01:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4593e40b-6b71-4910-8a07-9dee8fa42a94 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:01:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4593e40b-6b71-4910-8a07-9dee8fa42a94 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:01:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4593e40b-6b71-4910-8a07-9dee8fa42a94 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:01:22 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-4593e40b-6b71-4910-8a07-9dee8fa42a94 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa87f179b35a4d1db2336802e8f104e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa330c512f045dc8a5946be3563fdcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 16:01:22 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-4593e40b-6b71-4910-8a07-9dee8fa42a94 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e" status: 200 len: 1651 microversion: 2.1 time: 0.196141 Apr 11 16:01:22 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 339/1006] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:01:22 2023] GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e => generated 1651 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:01:25 user devstack@n-api.service[61165]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2290b1d4-22a2-492c-8aed-024685845370] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 11 16:01:25 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:01:25 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:01:25 user devstack@n-api.service[61165]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:01:25 user devstack@n-api.service[61165]: Tue Apr 11 16:01:25 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 11 16:01:25 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-6a4345ee-1935-4486-a809-e1a01707f552 req-0bdea181-80ba-4b61-bb6c-0b376f14eeeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6c5972-e53b-47e9-8f13-7df1ad86020e", "name": "network-vif-plugged", "status": "completed", "tag": "8fd17bd8-2470-4931-8df3-b1ca41125d39"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:01:25 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-6a4345ee-1935-4486-a809-e1a01707f552 req-0bdea181-80ba-4b61-bb6c-0b376f14eeeb service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:01:25 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-6a4345ee-1935-4486-a809-e1a01707f552 req-0bdea181-80ba-4b61-bb6c-0b376f14eeeb service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:01:25 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-6a4345ee-1935-4486-a809-e1a01707f552 req-0bdea181-80ba-4b61-bb6c-0b376f14eeeb service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:01:25 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-6a4345ee-1935-4486-a809-e1a01707f552 req-0bdea181-80ba-4b61-bb6c-0b376f14eeeb service nova] Creating event network-vif-plugged:8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e on user Apr 11 16:01:25 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-6a4345ee-1935-4486-a809-e1a01707f552 req-0bdea181-80ba-4b61-bb6c-0b376f14eeeb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057176 Apr 11 16:01:25 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 335/1007] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:01:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:01:27 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-5cde92a1-f990-4493-bb48-58a94d917a45 req-92a00d74-c6c4-4b4a-bb21-fdbf0f44da24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6c5972-e53b-47e9-8f13-7df1ad86020e", "name": "network-vif-plugged", "status": "completed", "tag": "8fd17bd8-2470-4931-8df3-b1ca41125d39"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:01:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-5cde92a1-f990-4493-bb48-58a94d917a45 req-92a00d74-c6c4-4b4a-bb21-fdbf0f44da24 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:01:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-5cde92a1-f990-4493-bb48-58a94d917a45 req-92a00d74-c6c4-4b4a-bb21-fdbf0f44da24 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:01:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-5cde92a1-f990-4493-bb48-58a94d917a45 req-92a00d74-c6c4-4b4a-bb21-fdbf0f44da24 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:01:27 user devstack@n-api.service[61166]: INFO oslo.messaging._drivers.impl_rabbit [-] [c34c4012-5e24-4363-ac5f-17d8dd71dc66] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 46220. Apr 11 16:01:27 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-5cde92a1-f990-4493-bb48-58a94d917a45 req-92a00d74-c6c4-4b4a-bb21-fdbf0f44da24 service nova] Creating event network-vif-plugged:8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e on user Apr 11 16:01:27 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-5cde92a1-f990-4493-bb48-58a94d917a45 req-92a00d74-c6c4-4b4a-bb21-fdbf0f44da24 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037013 Apr 11 16:01:27 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 334/1008] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:01:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:02:12 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-ce51fb7e-c031-4717-8420-79cadfa192fc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:02:12 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-ce51fb7e-c031-4717-8420-79cadfa192fc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:02:12 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:02:12 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:02:12 user devstack@n-api.service[61167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 11 16:02:12 user devstack@n-api.service[61167]: Tue Apr 11 16:02:12 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e (ip 10.0.0.210) !!! Apr 11 16:02:12 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ce51fb7e-c031-4717-8420-79cadfa192fc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:02:12 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ce51fb7e-c031-4717-8420-79cadfa192fc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:02:12 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ce51fb7e-c031-4717-8420-79cadfa192fc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:02:12 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ce51fb7e-c031-4717-8420-79cadfa192fc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:02:12 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ce51fb7e-c031-4717-8420-79cadfa192fc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:02:12 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ce51fb7e-c031-4717-8420-79cadfa192fc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:02:12 user devstack@n-api.service[61167]: INFO oslo.messaging._drivers.impl_rabbit [-] [f5e3bdb2-c95f-470f-b3a7-1902314e275b] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 50350. Apr 11 16:02:13 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-ce51fb7e-c031-4717-8420-79cadfa192fc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa87f179b35a4d1db2336802e8f104e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa330c512f045dc8a5946be3563fdcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 16:02:13 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-ce51fb7e-c031-4717-8420-79cadfa192fc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e" status: 200 len: 1655 microversion: 2.1 time: 0.187960 Apr 11 16:02:13 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 340/1009] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:02:12 2023] GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e => generated 1655 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:03:13 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:03:13 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:03:13 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-0289cca5-8081-4fec-8e8f-f10f5b1d2807 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:03:13 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-0289cca5-8081-4fec-8e8f-f10f5b1d2807 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:03:13 user devstack@n-api.service[61165]: INFO oslo.messaging._drivers.impl_rabbit [-] [2290b1d4-22a2-492c-8aed-024685845370] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 42244. Apr 11 16:03:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-0289cca5-8081-4fec-8e8f-f10f5b1d2807 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:03:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-0289cca5-8081-4fec-8e8f-f10f5b1d2807 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:03:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-0289cca5-8081-4fec-8e8f-f10f5b1d2807 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:03:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-0289cca5-8081-4fec-8e8f-f10f5b1d2807 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:03:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-0289cca5-8081-4fec-8e8f-f10f5b1d2807 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:03:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-0289cca5-8081-4fec-8e8f-f10f5b1d2807 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:03:13 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-0289cca5-8081-4fec-8e8f-f10f5b1d2807 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054166 Apr 11 16:03:13 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 336/1010] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 16:03:13 2023] GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 16:03:13 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:03:13 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:03:13 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:03:13 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:03:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:03:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:03:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:03:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:03:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:03:13 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:03:13 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Going to try to terminate instance {{(pid=61166) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 16:03:13 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e" status: 204 len: 0 microversion: 2.1 time: 0.172436 Apr 11 16:03:13 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 335/1011] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 16:03:13 2023] DELETE /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 16:03:13 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:03:13 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:03:13 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-4f3af893-277a-429c-8798-f0a205110e28 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:03:13 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-4f3af893-277a-429c-8798-f0a205110e28 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:03:13 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4f3af893-277a-429c-8798-f0a205110e28 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:03:13 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4f3af893-277a-429c-8798-f0a205110e28 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:03:13 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4f3af893-277a-429c-8798-f0a205110e28 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:03:13 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4f3af893-277a-429c-8798-f0a205110e28 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:03:13 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4f3af893-277a-429c-8798-f0a205110e28 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:03:13 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4f3af893-277a-429c-8798-f0a205110e28 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:03:13 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-1bf0043a-ab40-4c38-93d1-3991dcb3ef21 req-ca21cd14-4bd0-4b7c-b867-d061b648e647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6c5972-e53b-47e9-8f13-7df1ad86020e", "name": "network-vif-unplugged", "status": "completed", "tag": "8fd17bd8-2470-4931-8df3-b1ca41125d39"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:03:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-1bf0043a-ab40-4c38-93d1-3991dcb3ef21 req-ca21cd14-4bd0-4b7c-b867-d061b648e647 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:03:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-1bf0043a-ab40-4c38-93d1-3991dcb3ef21 req-ca21cd14-4bd0-4b7c-b867-d061b648e647 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:03:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-1bf0043a-ab40-4c38-93d1-3991dcb3ef21 req-ca21cd14-4bd0-4b7c-b867-d061b648e647 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:03:13 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-1bf0043a-ab40-4c38-93d1-3991dcb3ef21 req-ca21cd14-4bd0-4b7c-b867-d061b648e647 service nova] Creating event network-vif-unplugged:8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e on user Apr 11 16:03:13 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-1bf0043a-ab40-4c38-93d1-3991dcb3ef21 req-ca21cd14-4bd0-4b7c-b867-d061b648e647 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028771 Apr 11 16:03:13 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 337/1012] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:03:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:03:13 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-4f3af893-277a-429c-8798-f0a205110e28 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa87f179b35a4d1db2336802e8f104e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa330c512f045dc8a5946be3563fdcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 16:03:13 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-4f3af893-277a-429c-8798-f0a205110e28 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e" status: 200 len: 1661 microversion: 2.1 time: 0.310471 Apr 11 16:03:13 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 341/1013] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:03:13 2023] GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e => generated 1661 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:03:15 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-36fdfc3b-6f74-40a5-889b-2dc51cede6d6 req-6d2033da-d6bc-4d8a-b39c-780a7d3ec837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6c5972-e53b-47e9-8f13-7df1ad86020e", "name": "network-vif-deleted", "tag": "8fd17bd8-2470-4931-8df3-b1ca41125d39"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:03:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-36fdfc3b-6f74-40a5-889b-2dc51cede6d6 req-6d2033da-d6bc-4d8a-b39c-780a7d3ec837 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:03:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-36fdfc3b-6f74-40a5-889b-2dc51cede6d6 req-6d2033da-d6bc-4d8a-b39c-780a7d3ec837 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:03:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-36fdfc3b-6f74-40a5-889b-2dc51cede6d6 req-6d2033da-d6bc-4d8a-b39c-780a7d3ec837 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:03:15 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-36fdfc3b-6f74-40a5-889b-2dc51cede6d6 req-6d2033da-d6bc-4d8a-b39c-780a7d3ec837 service nova] Creating event network-vif-deleted:8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e on user Apr 11 16:03:15 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-36fdfc3b-6f74-40a5-889b-2dc51cede6d6 req-6d2033da-d6bc-4d8a-b39c-780a7d3ec837 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116662 Apr 11 16:03:15 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 336/1014] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:03:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:03:15 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-eaad2b83-3cd3-4c15-b5d2-92ab41bd3036 req-6fbb7304-4eab-431a-ad43-1cdcf0f44b51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6c5972-e53b-47e9-8f13-7df1ad86020e", "name": "network-vif-plugged", "status": "completed", "tag": "8fd17bd8-2470-4931-8df3-b1ca41125d39"}, {"server_uuid": "0d6c5972-e53b-47e9-8f13-7df1ad86020e", "name": "network-vif-plugged", "status": "completed", "tag": "8fd17bd8-2470-4931-8df3-b1ca41125d39"}, {"server_uuid": "0d6c5972-e53b-47e9-8f13-7df1ad86020e", "name": "network-vif-plugged", "status": "completed", "tag": "8fd17bd8-2470-4931-8df3-b1ca41125d39"}, {"server_uuid": "0d6c5972-e53b-47e9-8f13-7df1ad86020e", "name": "network-vif-unplugged", "status": "completed", "tag": "8fd17bd8-2470-4931-8df3-b1ca41125d39"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:03:15 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-eaad2b83-3cd3-4c15-b5d2-92ab41bd3036 req-6fbb7304-4eab-431a-ad43-1cdcf0f44b51 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:03:15 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-eaad2b83-3cd3-4c15-b5d2-92ab41bd3036 req-6fbb7304-4eab-431a-ad43-1cdcf0f44b51 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:03:15 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-eaad2b83-3cd3-4c15-b5d2-92ab41bd3036 req-6fbb7304-4eab-431a-ad43-1cdcf0f44b51 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:03:15 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-eaad2b83-3cd3-4c15-b5d2-92ab41bd3036 req-6fbb7304-4eab-431a-ad43-1cdcf0f44b51 service nova] Creating event network-vif-plugged:8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e on user Apr 11 16:03:15 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-eaad2b83-3cd3-4c15-b5d2-92ab41bd3036 req-6fbb7304-4eab-431a-ad43-1cdcf0f44b51 service nova] Creating event network-vif-plugged:8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e on user Apr 11 16:03:15 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-eaad2b83-3cd3-4c15-b5d2-92ab41bd3036 req-6fbb7304-4eab-431a-ad43-1cdcf0f44b51 service nova] Creating event network-vif-plugged:8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e on user Apr 11 16:03:15 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-eaad2b83-3cd3-4c15-b5d2-92ab41bd3036 req-6fbb7304-4eab-431a-ad43-1cdcf0f44b51 service nova] Creating event network-vif-unplugged:8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e on user Apr 11 16:03:15 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-eaad2b83-3cd3-4c15-b5d2-92ab41bd3036 req-6fbb7304-4eab-431a-ad43-1cdcf0f44b51 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.031868 Apr 11 16:03:15 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 338/1015] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:03:15 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:03:18 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-5fdd380f-6d1b-4ab8-8ffb-b17c1d985b66 req-3382e328-95e4-46fb-87f9-6ea8b089beb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6c5972-e53b-47e9-8f13-7df1ad86020e", "name": "network-vif-plugged", "status": "completed", "tag": "8fd17bd8-2470-4931-8df3-b1ca41125d39"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:03:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-5fdd380f-6d1b-4ab8-8ffb-b17c1d985b66 req-3382e328-95e4-46fb-87f9-6ea8b089beb2 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:03:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-5fdd380f-6d1b-4ab8-8ffb-b17c1d985b66 req-3382e328-95e4-46fb-87f9-6ea8b089beb2 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:03:18 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-5fdd380f-6d1b-4ab8-8ffb-b17c1d985b66 req-3382e328-95e4-46fb-87f9-6ea8b089beb2 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:03:18 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-5fdd380f-6d1b-4ab8-8ffb-b17c1d985b66 req-3382e328-95e4-46fb-87f9-6ea8b089beb2 service nova] Creating event network-vif-plugged:8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e on user Apr 11 16:03:18 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-5fdd380f-6d1b-4ab8-8ffb-b17c1d985b66 req-3382e328-95e4-46fb-87f9-6ea8b089beb2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028797 Apr 11 16:03:18 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 342/1016] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:03:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:04:03 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:04:03 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:04:03 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-76c1bf7c-7d53-4e10-844b-3cb6aaa0ed74 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:04:03 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-76c1bf7c-7d53-4e10-844b-3cb6aaa0ed74 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:04:03 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-76c1bf7c-7d53-4e10-844b-3cb6aaa0ed74 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:04:03 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-76c1bf7c-7d53-4e10-844b-3cb6aaa0ed74 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:04:03 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-76c1bf7c-7d53-4e10-844b-3cb6aaa0ed74 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:04:03 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-76c1bf7c-7d53-4e10-844b-3cb6aaa0ed74 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:04:03 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-76c1bf7c-7d53-4e10-844b-3cb6aaa0ed74 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:04:03 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-76c1bf7c-7d53-4e10-844b-3cb6aaa0ed74 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:04:04 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-76c1bf7c-7d53-4e10-844b-3cb6aaa0ed74 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] HTTP exception thrown: Instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e could not be found. Apr 11 16:04:04 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-76c1bf7c-7d53-4e10-844b-3cb6aaa0ed74 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Request method failure captured: Apr 11 16:04:04 user devstack@n-api.service[61166]: request: GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e HTTP/1.1 Apr 11 16:04:04 user devstack@n-api.service[61166]: Accept: application/json Apr 11 16:04:04 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 16:04:04 user devstack@n-api.service[61166]: Connection: close Apr 11 16:04:04 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 16:04:04 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 16:04:04 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 16:04:04 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 16:04:04 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 16:04:04 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNYKJlYgSQrLW4wTTdF7hhMiA883Z4FCCU-9ilcL3OKNa-1o2kiHQV1qUJKP-NPMKS9_EtBEaFGn142JBdK-SfIKy9kcRv_awuG6vLP84uFSjMHxFyX07iPLEDwr7KCLPBc6f_8eSCYtBKagkDjbHTTSVr-43_0nXNIzCdGTp5hwuk1g Apr 11 16:04:04 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 16:04:04 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 16:04:04 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 16:04:04 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 16:04:04 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 16:04:04 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 16:04:04 user devstack@n-api.service[61166]: X-Project-Id: 8fa330c512f045dc8a5946be3563fdcd Apr 11 16:04:04 user devstack@n-api.service[61166]: X-Project-Name: tempest-AttachVolumeTestJSON-1691938977 Apr 11 16:04:04 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 16:04:04 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 16:04:04 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8fa330c512f045dc8a5946be3563fdcd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8fa330c512f045dc8a5946be3563fdcd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8fa330c512f045dc8a5946be3563fdcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 16:04:04 user devstack@n-api.service[61166]: X-Tenant: tempest-AttachVolumeTestJSON-1691938977 Apr 11 16:04:04 user devstack@n-api.service[61166]: X-Tenant-Id: 8fa330c512f045dc8a5946be3563fdcd Apr 11 16:04:04 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1691938977 Apr 11 16:04:04 user devstack@n-api.service[61166]: X-User: tempest-AttachVolumeTestJSON-1691938977-project-member Apr 11 16:04:04 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 16:04:04 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 16:04:04 user devstack@n-api.service[61166]: X-User-Id: aa87f179b35a4d1db2336802e8f104e4 Apr 11 16:04:04 user devstack@n-api.service[61166]: X-User-Name: tempest-AttachVolumeTestJSON-1691938977-project-member Apr 11 16:04:04 user devstack@n-api.service[61166]: method: > Apr 11 16:04:04 user devstack@n-api.service[61166]: exception: Instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e could not be found. Apr 11 16:04:04 user devstack@n-api.service[61166]: action_args: {'id': '0d6c5972-e53b-47e9-8f13-7df1ad86020e'} Apr 11 16:04:04 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e could not be found. Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e could not be found. Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e could not be found. Apr 11 16:04:04 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:04:04 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-76c1bf7c-7d53-4e10-844b-3cb6aaa0ed74 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Returning 404 to user: Instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e could not be found. {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 16:04:04 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-76c1bf7c-7d53-4e10-844b-3cb6aaa0ed74 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e" status: 404 len: 111 microversion: 2.1 time: 0.039256 Apr 11 16:04:04 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 337/1017] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:04:03 2023] GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:04:04 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:04:04 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=10 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:04:04 user devstack@n-api.service[61165]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 11 16:04:04 user devstack@n-api.service[61165]: Tue Apr 11 16:04:04 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1501547376 (ip 10.0.0.210) !!! Apr 11 16:04:04 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-2f9296dd-2b5d-4d1a-b5c0-cce2b57114cb tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '.version_select at 0x7f4c2eb3dab0>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:04:04 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-2f9296dd-2b5d-4d1a-b5c0-cce2b57114cb tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1501547376" status: 202 len: 0 microversion: 2.1 time: 0.131012 Apr 11 16:04:04 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 339/1018] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 16:04:04 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1501547376 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:04:04 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=4 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:04:04 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=8 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:04:04 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-5aabff85-ed62-4dbf-a1e5-84f4c4a5e05c tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Action: 'create', calling method: .version_select at 0x7f4c2edf9d80>, body: {"keypair": {"name": "tempest-keypair-1137335061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3Vd/gPFHz73t2nUBm8NxBQLIDsgPm1EYQOBLUif7Y740J+h2EGFkfTc7lHtnfvKweVN3WVhYM4TjSp+rH5npDx4XBTO229iAcUP9TXjmix55FPHQC3XqKMkif0pTVxFw=="}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:04:04 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-5aabff85-ed62-4dbf-a1e5-84f4c4a5e05c tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Getting quotas for project 8fa330c512f045dc8a5946be3563fdcd. Resources: {'key_pairs'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:04:04 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-5aabff85-ed62-4dbf-a1e5-84f4c4a5e05c tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Getting quotas for user aa87f179b35a4d1db2336802e8f104e4 and project 8fa330c512f045dc8a5946be3563fdcd. Resources: {'key_pairs'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:04:04 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-5aabff85-ed62-4dbf-a1e5-84f4c4a5e05c tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.065902 Apr 11 16:04:04 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 343/1019] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 16:04:04 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:04:06 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-710249164", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "e6f9483b-53f6-4696-b451-52aeb6ec13d3"}], "security_groups": [{"name": "tempest-securitygroup--1375880326"}], "key_name": "tempest-keypair-1137335061", "user_data": "}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:04:06 user devstack@n-api.service[61166]: DEBUG nova.network.neutron [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] validate_networks() for [('e6f9483b-53f6-4696-b451-52aeb6ec13d3', None, None, None, None, None)] {{(pid=61166) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 16:04:06 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Flavor limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 16:04:06 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Image limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 16:04:06 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Flavor pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 16:04:06 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Image pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 16:04:06 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 16:04:06 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:04:06 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:04:06 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:04:06 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:04:06 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:04:06 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:04:06 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Getting quotas for project 8fa330c512f045dc8a5946be3563fdcd. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:04:06 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Getting quotas for user aa87f179b35a4d1db2336802e8f104e4 and project 8fa330c512f045dc8a5946be3563fdcd. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:04:06 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Going to run 1 instances... {{(pid=61166) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 16:04:06 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52fe638c-5ada-47d5-b376-233bfa808a37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 16:04:06 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.600520 Apr 11 16:04:06 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 338/1020] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 16:04:06 2023] POST /compute/v2.1/servers => generated 400 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 16:04:06 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-b291ec5d-6e3f-42d2-8a51-35d3f82e4bcb tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:04:06 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-b291ec5d-6e3f-42d2-8a51-35d3f82e4bcb tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:04:06 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-b291ec5d-6e3f-42d2-8a51-35d3f82e4bcb tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa87f179b35a4d1db2336802e8f104e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa330c512f045dc8a5946be3563fdcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 16:04:06 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-b291ec5d-6e3f-42d2-8a51-35d3f82e4bcb tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05" status: 200 len: 1231 microversion: 2.1 time: 0.064380 Apr 11 16:04:06 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 340/1021] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:04:06 2023] GET /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05 => generated 1231 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:04:09 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-79ceaff3-114c-4558-b688-05c022b15d83 req-c4929f6e-f651-4949-b18d-b8f58b8bdb6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "babe1474-6141-4c29-a009-99b61e0c1a05", "tag": "52b531e9-3dd1-4fa2-9e5e-17127998ee74"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:04:09 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-79ceaff3-114c-4558-b688-05c022b15d83 req-c4929f6e-f651-4949-b18d-b8f58b8bdb6a service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:04:09 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-79ceaff3-114c-4558-b688-05c022b15d83 req-c4929f6e-f651-4949-b18d-b8f58b8bdb6a service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:04:09 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-79ceaff3-114c-4558-b688-05c022b15d83 req-c4929f6e-f651-4949-b18d-b8f58b8bdb6a service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:04:09 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-79ceaff3-114c-4558-b688-05c022b15d83 req-c4929f6e-f651-4949-b18d-b8f58b8bdb6a service nova] Creating event network-changed:52b531e9-3dd1-4fa2-9e5e-17127998ee74 for instance babe1474-6141-4c29-a009-99b61e0c1a05 on user Apr 11 16:04:09 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-79ceaff3-114c-4558-b688-05c022b15d83 req-c4929f6e-f651-4949-b18d-b8f58b8bdb6a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029561 Apr 11 16:04:09 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 344/1022] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:04:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:04:11 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-7b59955f-7aaf-4a6d-8869-6fe957dcf3d1 req-30ab0b8a-6e61-4de9-9bdb-1b5adc607139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "babe1474-6141-4c29-a009-99b61e0c1a05", "name": "network-vif-plugged", "status": "completed", "tag": "52b531e9-3dd1-4fa2-9e5e-17127998ee74"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:04:11 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-7b59955f-7aaf-4a6d-8869-6fe957dcf3d1 req-30ab0b8a-6e61-4de9-9bdb-1b5adc607139 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:04:11 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-7b59955f-7aaf-4a6d-8869-6fe957dcf3d1 req-30ab0b8a-6e61-4de9-9bdb-1b5adc607139 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:04:11 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-7b59955f-7aaf-4a6d-8869-6fe957dcf3d1 req-30ab0b8a-6e61-4de9-9bdb-1b5adc607139 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:04:11 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-7b59955f-7aaf-4a6d-8869-6fe957dcf3d1 req-30ab0b8a-6e61-4de9-9bdb-1b5adc607139 service nova] Creating event network-vif-plugged:52b531e9-3dd1-4fa2-9e5e-17127998ee74 for instance babe1474-6141-4c29-a009-99b61e0c1a05 on user Apr 11 16:04:11 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-7b59955f-7aaf-4a6d-8869-6fe957dcf3d1 req-30ab0b8a-6e61-4de9-9bdb-1b5adc607139 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097942 Apr 11 16:04:11 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 339/1023] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:04:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:04:13 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-4f2c5cb1-d643-408f-a162-64a100bd7d95 req-dd24ab22-8f2f-4549-8601-272f3c196993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "babe1474-6141-4c29-a009-99b61e0c1a05", "name": "network-vif-plugged", "status": "completed", "tag": "52b531e9-3dd1-4fa2-9e5e-17127998ee74"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:04:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-4f2c5cb1-d643-408f-a162-64a100bd7d95 req-dd24ab22-8f2f-4549-8601-272f3c196993 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:04:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-4f2c5cb1-d643-408f-a162-64a100bd7d95 req-dd24ab22-8f2f-4549-8601-272f3c196993 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:04:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-4f2c5cb1-d643-408f-a162-64a100bd7d95 req-dd24ab22-8f2f-4549-8601-272f3c196993 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:04:13 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-4f2c5cb1-d643-408f-a162-64a100bd7d95 req-dd24ab22-8f2f-4549-8601-272f3c196993 service nova] Creating event network-vif-plugged:52b531e9-3dd1-4fa2-9e5e-17127998ee74 for instance babe1474-6141-4c29-a009-99b61e0c1a05 on user Apr 11 16:04:13 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-4f2c5cb1-d643-408f-a162-64a100bd7d95 req-dd24ab22-8f2f-4549-8601-272f3c196993 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029324 Apr 11 16:04:13 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 341/1024] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:04:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:04:57 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=4 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:04:57 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:04:57 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:04:57 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-7263145d-32ff-4c1a-8bcf-6d75c7715323 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:04:57 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-7263145d-32ff-4c1a-8bcf-6d75c7715323 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:04:57 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7263145d-32ff-4c1a-8bcf-6d75c7715323 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:04:57 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7263145d-32ff-4c1a-8bcf-6d75c7715323 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:04:57 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7263145d-32ff-4c1a-8bcf-6d75c7715323 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:04:57 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7263145d-32ff-4c1a-8bcf-6d75c7715323 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:04:57 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7263145d-32ff-4c1a-8bcf-6d75c7715323 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:04:57 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7263145d-32ff-4c1a-8bcf-6d75c7715323 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:04:57 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-7263145d-32ff-4c1a-8bcf-6d75c7715323 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa87f179b35a4d1db2336802e8f104e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa330c512f045dc8a5946be3563fdcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 16:04:57 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-7263145d-32ff-4c1a-8bcf-6d75c7715323 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05" status: 200 len: 1538 microversion: 2.1 time: 0.221735 Apr 11 16:04:57 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 345/1025] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:04:57 2023] GET /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05 => generated 1538 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:05:57 user devstack@n-api.service[61166]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c34c4012-5e24-4363-ac5f-17d8dd71dc66] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 11 16:05:57 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:05:57 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:05:57 user devstack@n-api.service[61166]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:05:57 user devstack@n-api.service[61166]: Tue Apr 11 16:05:57 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05/os-interface (ip 10.0.0.210) !!! Apr 11 16:05:57 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:05:57 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:05:57 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-750dd3eb-8e10-43bd-8032-6ce859e38091 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:05:57 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-750dd3eb-8e10-43bd-8032-6ce859e38091 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:05:57 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-750dd3eb-8e10-43bd-8032-6ce859e38091 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:05:57 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-750dd3eb-8e10-43bd-8032-6ce859e38091 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:05:57 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-750dd3eb-8e10-43bd-8032-6ce859e38091 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:05:57 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-750dd3eb-8e10-43bd-8032-6ce859e38091 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:05:57 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-750dd3eb-8e10-43bd-8032-6ce859e38091 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:05:57 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-750dd3eb-8e10-43bd-8032-6ce859e38091 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:05:57 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-750dd3eb-8e10-43bd-8032-6ce859e38091 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.191752 Apr 11 16:05:57 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 340/1026] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 16:05:57 2023] GET /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05/os-interface => generated 283 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:05:58 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:05:58 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:05:58 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:05:58 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-3ed3e4ab-5dc5-4be0-b75f-ba87dcc27544 req-bee5de59-44e5-46f4-bdaf-d7493af5f17d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "babe1474-6141-4c29-a009-99b61e0c1a05", "tag": "52b531e9-3dd1-4fa2-9e5e-17127998ee74"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:05:58 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-3ed3e4ab-5dc5-4be0-b75f-ba87dcc27544 req-bee5de59-44e5-46f4-bdaf-d7493af5f17d service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:05:58 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-3ed3e4ab-5dc5-4be0-b75f-ba87dcc27544 req-bee5de59-44e5-46f4-bdaf-d7493af5f17d service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:05:58 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-3ed3e4ab-5dc5-4be0-b75f-ba87dcc27544 req-bee5de59-44e5-46f4-bdaf-d7493af5f17d service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:05:58 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-3ed3e4ab-5dc5-4be0-b75f-ba87dcc27544 req-bee5de59-44e5-46f4-bdaf-d7493af5f17d service nova] Creating event network-changed:52b531e9-3dd1-4fa2-9e5e-17127998ee74 for instance babe1474-6141-4c29-a009-99b61e0c1a05 on user Apr 11 16:05:58 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-3ed3e4ab-5dc5-4be0-b75f-ba87dcc27544 req-bee5de59-44e5-46f4-bdaf-d7493af5f17d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038313 Apr 11 16:05:58 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 342/1027] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:05:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:05:58 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:05:58 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:05:58 user devstack@n-api.service[61167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:05:58 user devstack@n-api.service[61167]: Tue Apr 11 16:05:58 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05/ips (ip 10.0.0.210) !!! Apr 11 16:05:58 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-71844af8-9c56-4c86-9cdd-3c16a2ea5548 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:05:58 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-71844af8-9c56-4c86-9cdd-3c16a2ea5548 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:05:58 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-71844af8-9c56-4c86-9cdd-3c16a2ea5548 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:05:58 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-71844af8-9c56-4c86-9cdd-3c16a2ea5548 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:05:58 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-71844af8-9c56-4c86-9cdd-3c16a2ea5548 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:05:58 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-71844af8-9c56-4c86-9cdd-3c16a2ea5548 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:05:58 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-71844af8-9c56-4c86-9cdd-3c16a2ea5548 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:05:58 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-71844af8-9c56-4c86-9cdd-3c16a2ea5548 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:05:58 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-71844af8-9c56-4c86-9cdd-3c16a2ea5548 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05/ips" status: 200 len: 105 microversion: 2.1 time: 0.051631 Apr 11 16:05:58 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 346/1028] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 16:05:58 2023] GET /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05/ips => generated 105 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:05:59 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3ad4959-12c1-4df7-8c6a-c124bf81483b"}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:05:59 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:05:59 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:05:59 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:05:59 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:05:59 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:05:59 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:05:59 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:05:59 user devstack@n-api.service[61166]: INFO oslo.messaging._drivers.impl_rabbit [-] [c34c4012-5e24-4363-ac5f-17d8dd71dc66] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 51934. Apr 11 16:06:00 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "POST /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317596 Apr 11 16:06:00 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 341/1029] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 16:05:59 2023] POST /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:06:06 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-1c68eab4-615b-4aa7-970b-be878ad2771b tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:06:06 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-1c68eab4-615b-4aa7-970b-be878ad2771b tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:06:06 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-1c68eab4-615b-4aa7-970b-be878ad2771b tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:06:06 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-1c68eab4-615b-4aa7-970b-be878ad2771b tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:06:06 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-1c68eab4-615b-4aa7-970b-be878ad2771b tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:06:06 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-1c68eab4-615b-4aa7-970b-be878ad2771b tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:06:06 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-1c68eab4-615b-4aa7-970b-be878ad2771b tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:06:06 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-1c68eab4-615b-4aa7-970b-be878ad2771b tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:06:06 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-1c68eab4-615b-4aa7-970b-be878ad2771b tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046956 Apr 11 16:06:06 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 343/1030] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 16:06:06 2023] GET /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:06:06 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-d573bf08-8059-44a7-a8b3-4e0c564dde62 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:06:06 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-d573bf08-8059-44a7-a8b3-4e0c564dde62 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:06:06 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d573bf08-8059-44a7-a8b3-4e0c564dde62 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:06:06 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d573bf08-8059-44a7-a8b3-4e0c564dde62 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:06:06 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d573bf08-8059-44a7-a8b3-4e0c564dde62 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:06:06 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d573bf08-8059-44a7-a8b3-4e0c564dde62 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:06:06 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d573bf08-8059-44a7-a8b3-4e0c564dde62 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:06:06 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-d573bf08-8059-44a7-a8b3-4e0c564dde62 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:06:06 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-d573bf08-8059-44a7-a8b3-4e0c564dde62 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05/os-volume_attachments/c3ad4959-12c1-4df7-8c6a-c124bf81483b" status: 200 len: 194 microversion: 2.1 time: 0.044928 Apr 11 16:06:06 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 347/1031] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Apr 11 16:06:06 2023] GET /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05/os-volume_attachments/c3ad4959-12c1-4df7-8c6a-c124bf81483b => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:06:08 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab44220b-9867-4d21-a0d5-01e6f22f21b3"}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:06:08 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:06:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:06:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:06:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:06:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:06:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:06:08 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:06:08 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "POST /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.325339 Apr 11 16:06:08 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 342/1032] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 16:06:08 2023] POST /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:06:14 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-6b69f686-7dd5-4625-beac-9a1e7e064b74 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:06:14 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-6b69f686-7dd5-4625-beac-9a1e7e064b74 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:06:14 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-6b69f686-7dd5-4625-beac-9a1e7e064b74 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:06:14 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-6b69f686-7dd5-4625-beac-9a1e7e064b74 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:06:14 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-6b69f686-7dd5-4625-beac-9a1e7e064b74 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:06:14 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-6b69f686-7dd5-4625-beac-9a1e7e064b74 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:06:14 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-6b69f686-7dd5-4625-beac-9a1e7e064b74 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:06:14 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-6b69f686-7dd5-4625-beac-9a1e7e064b74 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:06:14 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-6b69f686-7dd5-4625-beac-9a1e7e064b74 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043068 Apr 11 16:06:14 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 344/1033] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 16:06:14 2023] GET /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:06:15 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-c4a7ffaf-505e-4014-a026-9e1a6e01569b tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:06:15 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-c4a7ffaf-505e-4014-a026-9e1a6e01569b tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:06:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c4a7ffaf-505e-4014-a026-9e1a6e01569b tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:06:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c4a7ffaf-505e-4014-a026-9e1a6e01569b tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:06:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c4a7ffaf-505e-4014-a026-9e1a6e01569b tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:06:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c4a7ffaf-505e-4014-a026-9e1a6e01569b tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:06:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c4a7ffaf-505e-4014-a026-9e1a6e01569b tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:06:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-c4a7ffaf-505e-4014-a026-9e1a6e01569b tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:06:15 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-c4a7ffaf-505e-4014-a026-9e1a6e01569b tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05/os-volume_attachments/c3ad4959-12c1-4df7-8c6a-c124bf81483b" status: 200 len: 194 microversion: 2.1 time: 0.039424 Apr 11 16:06:15 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 348/1034] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Apr 11 16:06:15 2023] GET /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05/os-volume_attachments/c3ad4959-12c1-4df7-8c6a-c124bf81483b => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:06:15 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:06:15 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:06:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:06:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:06:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:06:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:06:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:06:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:06:15 user devstack@n-api.service[61166]: DEBUG nova.objects.instance [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'services' on Instance uuid babe1474-6141-4c29-a009-99b61e0c1a05 {{(pid=61166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 16:06:15 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05/os-volume_attachments/c3ad4959-12c1-4df7-8c6a-c124bf81483b" status: 202 len: 0 microversion: 2.1 time: 0.180853 Apr 11 16:06:15 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 343/1035] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 16:06:15 2023] DELETE /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05/os-volume_attachments/c3ad4959-12c1-4df7-8c6a-c124bf81483b => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:06:17 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-02406648-5bae-4e09-b38d-4b579d299700 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:06:17 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-02406648-5bae-4e09-b38d-4b579d299700 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:06:17 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-02406648-5bae-4e09-b38d-4b579d299700 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:06:17 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-02406648-5bae-4e09-b38d-4b579d299700 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:06:17 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-02406648-5bae-4e09-b38d-4b579d299700 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:06:17 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-02406648-5bae-4e09-b38d-4b579d299700 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:06:17 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-02406648-5bae-4e09-b38d-4b579d299700 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:06:17 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-02406648-5bae-4e09-b38d-4b579d299700 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:06:17 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-02406648-5bae-4e09-b38d-4b579d299700 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05/os-volume_attachments/ab44220b-9867-4d21-a0d5-01e6f22f21b3" status: 200 len: 194 microversion: 2.1 time: 0.047406 Apr 11 16:06:17 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 345/1036] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Apr 11 16:06:17 2023] GET /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05/os-volume_attachments/ab44220b-9867-4d21-a0d5-01e6f22f21b3 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:06:17 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:06:17 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:06:17 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:06:17 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:06:17 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:06:17 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:06:17 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:06:17 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:06:17 user devstack@n-api.service[61167]: DEBUG nova.objects.instance [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'services' on Instance uuid babe1474-6141-4c29-a009-99b61e0c1a05 {{(pid=61167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 16:06:17 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05/os-volume_attachments/ab44220b-9867-4d21-a0d5-01e6f22f21b3" status: 202 len: 0 microversion: 2.1 time: 0.193364 Apr 11 16:06:17 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 349/1037] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 16:06:17 2023] DELETE /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05/os-volume_attachments/ab44220b-9867-4d21-a0d5-01e6f22f21b3 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:06:19 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-135f247b-e6d1-4ecf-ae67-4bcbeb6ab337 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:06:19 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-135f247b-e6d1-4ecf-ae67-4bcbeb6ab337 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:06:19 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-135f247b-e6d1-4ecf-ae67-4bcbeb6ab337 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:06:19 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-135f247b-e6d1-4ecf-ae67-4bcbeb6ab337 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:06:19 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-135f247b-e6d1-4ecf-ae67-4bcbeb6ab337 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:06:19 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-135f247b-e6d1-4ecf-ae67-4bcbeb6ab337 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:06:19 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-135f247b-e6d1-4ecf-ae67-4bcbeb6ab337 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:06:19 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-135f247b-e6d1-4ecf-ae67-4bcbeb6ab337 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:06:19 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-135f247b-e6d1-4ecf-ae67-4bcbeb6ab337 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044536 Apr 11 16:06:19 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 344/1038] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 16:06:19 2023] GET /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 16:06:20 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-087785aa-06c6-4e76-9a1d-d6c3cb779819 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:06:20 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-087785aa-06c6-4e76-9a1d-d6c3cb779819 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:06:20 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-087785aa-06c6-4e76-9a1d-d6c3cb779819 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:06:20 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-087785aa-06c6-4e76-9a1d-d6c3cb779819 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:06:20 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-087785aa-06c6-4e76-9a1d-d6c3cb779819 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:06:20 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-087785aa-06c6-4e76-9a1d-d6c3cb779819 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:06:20 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-087785aa-06c6-4e76-9a1d-d6c3cb779819 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:06:20 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-087785aa-06c6-4e76-9a1d-d6c3cb779819 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:06:20 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-087785aa-06c6-4e76-9a1d-d6c3cb779819 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043855 Apr 11 16:06:20 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 346/1039] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 16:06:20 2023] GET /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 16:06:20 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:06:20 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:06:20 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:06:20 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:06:20 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:06:20 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:06:20 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:06:20 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:06:20 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Going to try to terminate instance {{(pid=61167) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 16:06:20 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05" status: 204 len: 0 microversion: 2.1 time: 0.108813 Apr 11 16:06:20 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 350/1040] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 16:06:20 2023] DELETE /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 16:06:20 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-b9f063ca-8730-432b-b245-63557c3a09dc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:06:20 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-b9f063ca-8730-432b-b245-63557c3a09dc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:06:20 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b9f063ca-8730-432b-b245-63557c3a09dc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:06:20 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b9f063ca-8730-432b-b245-63557c3a09dc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:06:20 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b9f063ca-8730-432b-b245-63557c3a09dc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:06:20 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b9f063ca-8730-432b-b245-63557c3a09dc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:06:20 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b9f063ca-8730-432b-b245-63557c3a09dc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:06:20 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b9f063ca-8730-432b-b245-63557c3a09dc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:06:20 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-b9f063ca-8730-432b-b245-63557c3a09dc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa87f179b35a4d1db2336802e8f104e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa330c512f045dc8a5946be3563fdcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 16:06:20 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-b9f063ca-8730-432b-b245-63557c3a09dc tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05" status: 200 len: 1663 microversion: 2.1 time: 0.222406 Apr 11 16:06:20 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 345/1041] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:06:20 2023] GET /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05 => generated 1663 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:06:20 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-8199ef75-9ca8-4f97-bb87-148b0778b532 req-5fa6083f-533f-4c5a-ac0b-e32261766fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "babe1474-6141-4c29-a009-99b61e0c1a05", "name": "network-vif-unplugged", "status": "completed", "tag": "52b531e9-3dd1-4fa2-9e5e-17127998ee74"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:06:20 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-8199ef75-9ca8-4f97-bb87-148b0778b532 req-5fa6083f-533f-4c5a-ac0b-e32261766fe3 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:06:20 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-8199ef75-9ca8-4f97-bb87-148b0778b532 req-5fa6083f-533f-4c5a-ac0b-e32261766fe3 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:06:20 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-8199ef75-9ca8-4f97-bb87-148b0778b532 req-5fa6083f-533f-4c5a-ac0b-e32261766fe3 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:06:20 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-8199ef75-9ca8-4f97-bb87-148b0778b532 req-5fa6083f-533f-4c5a-ac0b-e32261766fe3 service nova] Creating event network-vif-unplugged:52b531e9-3dd1-4fa2-9e5e-17127998ee74 for instance babe1474-6141-4c29-a009-99b61e0c1a05 on user Apr 11 16:06:20 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-8199ef75-9ca8-4f97-bb87-148b0778b532 req-5fa6083f-533f-4c5a-ac0b-e32261766fe3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031817 Apr 11 16:06:20 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 347/1042] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:06:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:06:22 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-1520238e-bb29-4645-ad05-92c2fd63d347 req-f810c3fd-4c5b-4faf-a719-01f3d4deca9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "babe1474-6141-4c29-a009-99b61e0c1a05", "name": "network-vif-deleted", "tag": "52b531e9-3dd1-4fa2-9e5e-17127998ee74"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:06:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-1520238e-bb29-4645-ad05-92c2fd63d347 req-f810c3fd-4c5b-4faf-a719-01f3d4deca9f service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:06:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-1520238e-bb29-4645-ad05-92c2fd63d347 req-f810c3fd-4c5b-4faf-a719-01f3d4deca9f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:06:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-1520238e-bb29-4645-ad05-92c2fd63d347 req-f810c3fd-4c5b-4faf-a719-01f3d4deca9f service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:06:22 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-1520238e-bb29-4645-ad05-92c2fd63d347 req-f810c3fd-4c5b-4faf-a719-01f3d4deca9f service nova] Creating event network-vif-deleted:52b531e9-3dd1-4fa2-9e5e-17127998ee74 for instance babe1474-6141-4c29-a009-99b61e0c1a05 on user Apr 11 16:06:22 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-1520238e-bb29-4645-ad05-92c2fd63d347 req-f810c3fd-4c5b-4faf-a719-01f3d4deca9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035756 Apr 11 16:06:22 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 351/1043] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:06:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:06:22 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-f7fcbbcf-269a-48c0-8c4f-202d277a7ee8 req-26842d9e-685b-428d-98d4-ded3f3f6c743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "babe1474-6141-4c29-a009-99b61e0c1a05", "name": "network-vif-plugged", "status": "completed", "tag": "52b531e9-3dd1-4fa2-9e5e-17127998ee74"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:06:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-f7fcbbcf-269a-48c0-8c4f-202d277a7ee8 req-26842d9e-685b-428d-98d4-ded3f3f6c743 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:06:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-f7fcbbcf-269a-48c0-8c4f-202d277a7ee8 req-26842d9e-685b-428d-98d4-ded3f3f6c743 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:06:22 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-f7fcbbcf-269a-48c0-8c4f-202d277a7ee8 req-26842d9e-685b-428d-98d4-ded3f3f6c743 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:06:22 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-f7fcbbcf-269a-48c0-8c4f-202d277a7ee8 req-26842d9e-685b-428d-98d4-ded3f3f6c743 service nova] Creating event network-vif-plugged:52b531e9-3dd1-4fa2-9e5e-17127998ee74 for instance babe1474-6141-4c29-a009-99b61e0c1a05 on user Apr 11 16:06:22 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-f7fcbbcf-269a-48c0-8c4f-202d277a7ee8 req-26842d9e-685b-428d-98d4-ded3f3f6c743 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027711 Apr 11 16:06:22 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 346/1044] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:06:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:07:10 user devstack@n-api.service[61165]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:07:10 user devstack@n-api.service[61165]: Tue Apr 11 16:07:10 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05 (ip 10.0.0.210) !!! Apr 11 16:07:10 user devstack@n-api.service[61165]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:07:10 user devstack@n-api.service[61165]: Tue Apr 11 16:07:10 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05 (ip 10.0.0.210) !!! Apr 11 16:07:10 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=12 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:07:10 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=28 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:07:10 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-cc666ed0-e36e-4697-a884-3aa4691fc2e0 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:07:10 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-cc666ed0-e36e-4697-a884-3aa4691fc2e0 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:07:10 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cc666ed0-e36e-4697-a884-3aa4691fc2e0 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:07:10 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cc666ed0-e36e-4697-a884-3aa4691fc2e0 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:07:10 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cc666ed0-e36e-4697-a884-3aa4691fc2e0 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:07:10 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cc666ed0-e36e-4697-a884-3aa4691fc2e0 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:07:10 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cc666ed0-e36e-4697-a884-3aa4691fc2e0 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:07:10 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cc666ed0-e36e-4697-a884-3aa4691fc2e0 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:07:10 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-cc666ed0-e36e-4697-a884-3aa4691fc2e0 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] HTTP exception thrown: Instance babe1474-6141-4c29-a009-99b61e0c1a05 could not be found. Apr 11 16:07:10 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-cc666ed0-e36e-4697-a884-3aa4691fc2e0 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Request method failure captured: Apr 11 16:07:10 user devstack@n-api.service[61165]: request: GET /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05 HTTP/1.1 Apr 11 16:07:10 user devstack@n-api.service[61165]: Accept: application/json Apr 11 16:07:10 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 16:07:10 user devstack@n-api.service[61165]: Connection: close Apr 11 16:07:10 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 16:07:10 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 16:07:10 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 16:07:10 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 16:07:10 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 16:07:10 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNYKJlYgSQrLW4wTTdF7hhMiA883Z4FCCU-9ilcL3OKNa-1o2kiHQV1qUJKP-NPMKS9_EtBEaFGn142JBdK-SfIKy9kcRv_awuG6vLP84uFSjMHxFyX07iPLEDwr7KCLPBc6f_8eSCYtBKagkDjbHTTSVr-43_0nXNIzCdGTp5hwuk1g Apr 11 16:07:10 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 16:07:10 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 16:07:10 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 16:07:10 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 16:07:10 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 16:07:10 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 16:07:10 user devstack@n-api.service[61165]: X-Project-Id: 8fa330c512f045dc8a5946be3563fdcd Apr 11 16:07:10 user devstack@n-api.service[61165]: X-Project-Name: tempest-AttachVolumeTestJSON-1691938977 Apr 11 16:07:10 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 16:07:10 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 16:07:10 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8fa330c512f045dc8a5946be3563fdcd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8fa330c512f045dc8a5946be3563fdcd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8fa330c512f045dc8a5946be3563fdcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 16:07:10 user devstack@n-api.service[61165]: X-Tenant: tempest-AttachVolumeTestJSON-1691938977 Apr 11 16:07:10 user devstack@n-api.service[61165]: X-Tenant-Id: 8fa330c512f045dc8a5946be3563fdcd Apr 11 16:07:10 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1691938977 Apr 11 16:07:10 user devstack@n-api.service[61165]: X-User: tempest-AttachVolumeTestJSON-1691938977-project-member Apr 11 16:07:10 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 16:07:10 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 16:07:10 user devstack@n-api.service[61165]: X-User-Id: aa87f179b35a4d1db2336802e8f104e4 Apr 11 16:07:10 user devstack@n-api.service[61165]: X-User-Name: tempest-AttachVolumeTestJSON-1691938977-project-member Apr 11 16:07:10 user devstack@n-api.service[61165]: method: > Apr 11 16:07:10 user devstack@n-api.service[61165]: exception: Instance babe1474-6141-4c29-a009-99b61e0c1a05 could not be found. Apr 11 16:07:10 user devstack@n-api.service[61165]: action_args: {'id': 'babe1474-6141-4c29-a009-99b61e0c1a05'} Apr 11 16:07:10 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance babe1474-6141-4c29-a009-99b61e0c1a05 could not be found. Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance babe1474-6141-4c29-a009-99b61e0c1a05 could not be found. Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance babe1474-6141-4c29-a009-99b61e0c1a05 could not be found. Apr 11 16:07:10 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:07:10 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-cc666ed0-e36e-4697-a884-3aa4691fc2e0 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Returning 404 to user: Instance babe1474-6141-4c29-a009-99b61e0c1a05 could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 16:07:10 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-cc666ed0-e36e-4697-a884-3aa4691fc2e0 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05" status: 404 len: 111 microversion: 2.1 time: 0.045331 Apr 11 16:07:10 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 348/1045] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:07:10 2023] GET /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:07:10 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:07:10 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=42,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:07:10 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-aad74d64-c6a4-4671-83b7-8ebba6aea0c3 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '.version_select at 0x7f4c2ed6ec20>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:07:10 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-aad74d64-c6a4-4671-83b7-8ebba6aea0c3 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1137335061" status: 202 len: 0 microversion: 2.1 time: 0.030465 Apr 11 16:07:10 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 352/1046] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 16:07:10 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1137335061 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:07:14 user devstack@n-api.service[61166]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:07:14 user devstack@n-api.service[61166]: Tue Apr 11 16:07:14 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05 (ip 10.0.0.210) !!! Apr 11 16:07:14 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=14 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:07:14 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:07:14 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-156943ed-29e1-4da8-8a9e-85e786ffd2d0 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:07:14 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-156943ed-29e1-4da8-8a9e-85e786ffd2d0 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:07:14 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-156943ed-29e1-4da8-8a9e-85e786ffd2d0 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:07:14 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-156943ed-29e1-4da8-8a9e-85e786ffd2d0 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:07:14 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-156943ed-29e1-4da8-8a9e-85e786ffd2d0 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:07:14 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-156943ed-29e1-4da8-8a9e-85e786ffd2d0 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:07:14 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-156943ed-29e1-4da8-8a9e-85e786ffd2d0 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:07:14 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-156943ed-29e1-4da8-8a9e-85e786ffd2d0 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:07:14 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-156943ed-29e1-4da8-8a9e-85e786ffd2d0 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] HTTP exception thrown: Instance babe1474-6141-4c29-a009-99b61e0c1a05 could not be found. Apr 11 16:07:14 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-156943ed-29e1-4da8-8a9e-85e786ffd2d0 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Request method failure captured: Apr 11 16:07:14 user devstack@n-api.service[61166]: request: DELETE /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05 HTTP/1.1 Apr 11 16:07:14 user devstack@n-api.service[61166]: Accept: application/json Apr 11 16:07:14 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 16:07:14 user devstack@n-api.service[61166]: Connection: close Apr 11 16:07:14 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 16:07:14 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 16:07:14 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 16:07:14 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 16:07:14 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 16:07:14 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNYKJlYgSQrLW4wTTdF7hhMiA883Z4FCCU-9ilcL3OKNa-1o2kiHQV1qUJKP-NPMKS9_EtBEaFGn142JBdK-SfIKy9kcRv_awuG6vLP84uFSjMHxFyX07iPLEDwr7KCLPBc6f_8eSCYtBKagkDjbHTTSVr-43_0nXNIzCdGTp5hwuk1g Apr 11 16:07:14 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 16:07:14 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 16:07:14 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 16:07:14 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 16:07:14 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 16:07:14 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 16:07:14 user devstack@n-api.service[61166]: X-Project-Id: 8fa330c512f045dc8a5946be3563fdcd Apr 11 16:07:14 user devstack@n-api.service[61166]: X-Project-Name: tempest-AttachVolumeTestJSON-1691938977 Apr 11 16:07:14 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 16:07:14 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 16:07:14 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8fa330c512f045dc8a5946be3563fdcd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8fa330c512f045dc8a5946be3563fdcd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8fa330c512f045dc8a5946be3563fdcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 16:07:14 user devstack@n-api.service[61166]: X-Tenant: tempest-AttachVolumeTestJSON-1691938977 Apr 11 16:07:14 user devstack@n-api.service[61166]: X-Tenant-Id: 8fa330c512f045dc8a5946be3563fdcd Apr 11 16:07:14 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1691938977 Apr 11 16:07:14 user devstack@n-api.service[61166]: X-User: tempest-AttachVolumeTestJSON-1691938977-project-member Apr 11 16:07:14 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 16:07:14 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 16:07:14 user devstack@n-api.service[61166]: X-User-Id: aa87f179b35a4d1db2336802e8f104e4 Apr 11 16:07:14 user devstack@n-api.service[61166]: X-User-Name: tempest-AttachVolumeTestJSON-1691938977-project-member Apr 11 16:07:14 user devstack@n-api.service[61166]: method: > Apr 11 16:07:14 user devstack@n-api.service[61166]: exception: Instance babe1474-6141-4c29-a009-99b61e0c1a05 could not be found. Apr 11 16:07:14 user devstack@n-api.service[61166]: action_args: {'id': 'babe1474-6141-4c29-a009-99b61e0c1a05'} Apr 11 16:07:14 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance babe1474-6141-4c29-a009-99b61e0c1a05 could not be found. Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance babe1474-6141-4c29-a009-99b61e0c1a05 could not be found. Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance babe1474-6141-4c29-a009-99b61e0c1a05 could not be found. Apr 11 16:07:14 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:07:14 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-156943ed-29e1-4da8-8a9e-85e786ffd2d0 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Returning 404 to user: Instance babe1474-6141-4c29-a009-99b61e0c1a05 could not be found. {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 16:07:14 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-156943ed-29e1-4da8-8a9e-85e786ffd2d0 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05" status: 404 len: 111 microversion: 2.1 time: 0.046113 Apr 11 16:07:14 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 347/1047] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 16:07:14 2023] DELETE /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:07:14 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-218f1fc1-3537-432f-b03b-bae7ff4c24c1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:07:14 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-218f1fc1-3537-432f-b03b-bae7ff4c24c1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:07:14 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-218f1fc1-3537-432f-b03b-bae7ff4c24c1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:07:14 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-218f1fc1-3537-432f-b03b-bae7ff4c24c1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:07:14 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-218f1fc1-3537-432f-b03b-bae7ff4c24c1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:07:14 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-218f1fc1-3537-432f-b03b-bae7ff4c24c1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:07:14 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-218f1fc1-3537-432f-b03b-bae7ff4c24c1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:07:14 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-218f1fc1-3537-432f-b03b-bae7ff4c24c1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:07:14 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-218f1fc1-3537-432f-b03b-bae7ff4c24c1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] HTTP exception thrown: Instance babe1474-6141-4c29-a009-99b61e0c1a05 could not be found. Apr 11 16:07:14 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-218f1fc1-3537-432f-b03b-bae7ff4c24c1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Request method failure captured: Apr 11 16:07:14 user devstack@n-api.service[61165]: request: GET /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05 HTTP/1.1 Apr 11 16:07:14 user devstack@n-api.service[61165]: Accept: application/json Apr 11 16:07:14 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 16:07:14 user devstack@n-api.service[61165]: Connection: close Apr 11 16:07:14 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 16:07:14 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 16:07:14 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 16:07:14 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 16:07:14 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 16:07:14 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNYKJlYgSQrLW4wTTdF7hhMiA883Z4FCCU-9ilcL3OKNa-1o2kiHQV1qUJKP-NPMKS9_EtBEaFGn142JBdK-SfIKy9kcRv_awuG6vLP84uFSjMHxFyX07iPLEDwr7KCLPBc6f_8eSCYtBKagkDjbHTTSVr-43_0nXNIzCdGTp5hwuk1g Apr 11 16:07:14 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 16:07:14 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 16:07:14 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 16:07:14 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 16:07:14 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 16:07:14 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 16:07:14 user devstack@n-api.service[61165]: X-Project-Id: 8fa330c512f045dc8a5946be3563fdcd Apr 11 16:07:14 user devstack@n-api.service[61165]: X-Project-Name: tempest-AttachVolumeTestJSON-1691938977 Apr 11 16:07:14 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 16:07:14 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 16:07:14 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8fa330c512f045dc8a5946be3563fdcd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8fa330c512f045dc8a5946be3563fdcd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8fa330c512f045dc8a5946be3563fdcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 16:07:14 user devstack@n-api.service[61165]: X-Tenant: tempest-AttachVolumeTestJSON-1691938977 Apr 11 16:07:14 user devstack@n-api.service[61165]: X-Tenant-Id: 8fa330c512f045dc8a5946be3563fdcd Apr 11 16:07:14 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1691938977 Apr 11 16:07:14 user devstack@n-api.service[61165]: X-User: tempest-AttachVolumeTestJSON-1691938977-project-member Apr 11 16:07:14 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 16:07:14 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 16:07:14 user devstack@n-api.service[61165]: X-User-Id: aa87f179b35a4d1db2336802e8f104e4 Apr 11 16:07:14 user devstack@n-api.service[61165]: X-User-Name: tempest-AttachVolumeTestJSON-1691938977-project-member Apr 11 16:07:14 user devstack@n-api.service[61165]: method: > Apr 11 16:07:14 user devstack@n-api.service[61165]: exception: Instance babe1474-6141-4c29-a009-99b61e0c1a05 could not be found. Apr 11 16:07:14 user devstack@n-api.service[61165]: action_args: {'id': 'babe1474-6141-4c29-a009-99b61e0c1a05'} Apr 11 16:07:14 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance babe1474-6141-4c29-a009-99b61e0c1a05 could not be found. Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance babe1474-6141-4c29-a009-99b61e0c1a05 could not be found. Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance babe1474-6141-4c29-a009-99b61e0c1a05 could not be found. Apr 11 16:07:14 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:07:14 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-218f1fc1-3537-432f-b03b-bae7ff4c24c1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Returning 404 to user: Instance babe1474-6141-4c29-a009-99b61e0c1a05 could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 16:07:14 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-218f1fc1-3537-432f-b03b-bae7ff4c24c1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05" status: 404 len: 111 microversion: 2.1 time: 0.031233 Apr 11 16:07:14 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 349/1048] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:07:14 2023] GET /compute/v2.1/servers/babe1474-6141-4c29-a009-99b61e0c1a05 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:07:15 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-b60bf88e-5d03-4942-bf5a-25232fcae393 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:07:15 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-b60bf88e-5d03-4942-bf5a-25232fcae393 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:07:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b60bf88e-5d03-4942-bf5a-25232fcae393 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:07:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b60bf88e-5d03-4942-bf5a-25232fcae393 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:07:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b60bf88e-5d03-4942-bf5a-25232fcae393 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:07:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b60bf88e-5d03-4942-bf5a-25232fcae393 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:07:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b60bf88e-5d03-4942-bf5a-25232fcae393 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:07:15 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b60bf88e-5d03-4942-bf5a-25232fcae393 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:07:15 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-b60bf88e-5d03-4942-bf5a-25232fcae393 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] HTTP exception thrown: Instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e could not be found. Apr 11 16:07:15 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-b60bf88e-5d03-4942-bf5a-25232fcae393 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Request method failure captured: Apr 11 16:07:15 user devstack@n-api.service[61167]: request: DELETE /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e HTTP/1.1 Apr 11 16:07:15 user devstack@n-api.service[61167]: Accept: application/json Apr 11 16:07:15 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 16:07:15 user devstack@n-api.service[61167]: Connection: close Apr 11 16:07:15 user devstack@n-api.service[61167]: Content-Length: 0 Apr 11 16:07:15 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 16:07:15 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 16:07:15 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 16:07:15 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 16:07:15 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNYKJlYgSQrLW4wTTdF7hhMiA883Z4FCCU-9ilcL3OKNa-1o2kiHQV1qUJKP-NPMKS9_EtBEaFGn142JBdK-SfIKy9kcRv_awuG6vLP84uFSjMHxFyX07iPLEDwr7KCLPBc6f_8eSCYtBKagkDjbHTTSVr-43_0nXNIzCdGTp5hwuk1g Apr 11 16:07:15 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 16:07:15 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 16:07:15 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 16:07:15 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 16:07:15 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 16:07:15 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 16:07:15 user devstack@n-api.service[61167]: X-Project-Id: 8fa330c512f045dc8a5946be3563fdcd Apr 11 16:07:15 user devstack@n-api.service[61167]: X-Project-Name: tempest-AttachVolumeTestJSON-1691938977 Apr 11 16:07:15 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 16:07:15 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 16:07:15 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8fa330c512f045dc8a5946be3563fdcd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8fa330c512f045dc8a5946be3563fdcd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8fa330c512f045dc8a5946be3563fdcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 16:07:15 user devstack@n-api.service[61167]: X-Tenant: tempest-AttachVolumeTestJSON-1691938977 Apr 11 16:07:15 user devstack@n-api.service[61167]: X-Tenant-Id: 8fa330c512f045dc8a5946be3563fdcd Apr 11 16:07:15 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1691938977 Apr 11 16:07:15 user devstack@n-api.service[61167]: X-User: tempest-AttachVolumeTestJSON-1691938977-project-member Apr 11 16:07:15 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 16:07:15 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 16:07:15 user devstack@n-api.service[61167]: X-User-Id: aa87f179b35a4d1db2336802e8f104e4 Apr 11 16:07:15 user devstack@n-api.service[61167]: X-User-Name: tempest-AttachVolumeTestJSON-1691938977-project-member Apr 11 16:07:15 user devstack@n-api.service[61167]: method: > Apr 11 16:07:15 user devstack@n-api.service[61167]: exception: Instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e could not be found. Apr 11 16:07:15 user devstack@n-api.service[61167]: action_args: {'id': '0d6c5972-e53b-47e9-8f13-7df1ad86020e'} Apr 11 16:07:15 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e could not be found. Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e could not be found. Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e could not be found. Apr 11 16:07:15 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 16:07:15 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-b60bf88e-5d03-4942-bf5a-25232fcae393 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Returning 404 to user: Instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e could not be found. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 16:07:15 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-b60bf88e-5d03-4942-bf5a-25232fcae393 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e" status: 404 len: 111 microversion: 2.1 time: 0.031481 Apr 11 16:07:15 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 353/1049] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 16:07:15 2023] DELETE /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:07:15 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-252d50f6-39a2-4f5e-96cf-eafc45d50162 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:07:15 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-252d50f6-39a2-4f5e-96cf-eafc45d50162 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:07:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-252d50f6-39a2-4f5e-96cf-eafc45d50162 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:07:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-252d50f6-39a2-4f5e-96cf-eafc45d50162 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:07:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-252d50f6-39a2-4f5e-96cf-eafc45d50162 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:07:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-252d50f6-39a2-4f5e-96cf-eafc45d50162 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:07:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-252d50f6-39a2-4f5e-96cf-eafc45d50162 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:07:15 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-252d50f6-39a2-4f5e-96cf-eafc45d50162 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:07:15 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-252d50f6-39a2-4f5e-96cf-eafc45d50162 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] HTTP exception thrown: Instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e could not be found. Apr 11 16:07:15 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-252d50f6-39a2-4f5e-96cf-eafc45d50162 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Request method failure captured: Apr 11 16:07:15 user devstack@n-api.service[61166]: request: GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e HTTP/1.1 Apr 11 16:07:15 user devstack@n-api.service[61166]: Accept: application/json Apr 11 16:07:15 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 16:07:15 user devstack@n-api.service[61166]: Connection: close Apr 11 16:07:15 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 16:07:15 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 16:07:15 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 16:07:15 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 16:07:15 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 16:07:15 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNYKJlYgSQrLW4wTTdF7hhMiA883Z4FCCU-9ilcL3OKNa-1o2kiHQV1qUJKP-NPMKS9_EtBEaFGn142JBdK-SfIKy9kcRv_awuG6vLP84uFSjMHxFyX07iPLEDwr7KCLPBc6f_8eSCYtBKagkDjbHTTSVr-43_0nXNIzCdGTp5hwuk1g Apr 11 16:07:15 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 16:07:15 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 16:07:15 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 16:07:15 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 16:07:15 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 16:07:15 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 16:07:15 user devstack@n-api.service[61166]: X-Project-Id: 8fa330c512f045dc8a5946be3563fdcd Apr 11 16:07:15 user devstack@n-api.service[61166]: X-Project-Name: tempest-AttachVolumeTestJSON-1691938977 Apr 11 16:07:15 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 16:07:15 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 16:07:15 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8fa330c512f045dc8a5946be3563fdcd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8fa330c512f045dc8a5946be3563fdcd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8fa330c512f045dc8a5946be3563fdcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 16:07:15 user devstack@n-api.service[61166]: X-Tenant: tempest-AttachVolumeTestJSON-1691938977 Apr 11 16:07:15 user devstack@n-api.service[61166]: X-Tenant-Id: 8fa330c512f045dc8a5946be3563fdcd Apr 11 16:07:15 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1691938977 Apr 11 16:07:15 user devstack@n-api.service[61166]: X-User: tempest-AttachVolumeTestJSON-1691938977-project-member Apr 11 16:07:15 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 16:07:15 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 16:07:15 user devstack@n-api.service[61166]: X-User-Id: aa87f179b35a4d1db2336802e8f104e4 Apr 11 16:07:15 user devstack@n-api.service[61166]: X-User-Name: tempest-AttachVolumeTestJSON-1691938977-project-member Apr 11 16:07:15 user devstack@n-api.service[61166]: method: > Apr 11 16:07:15 user devstack@n-api.service[61166]: exception: Instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e could not be found. Apr 11 16:07:15 user devstack@n-api.service[61166]: action_args: {'id': '0d6c5972-e53b-47e9-8f13-7df1ad86020e'} Apr 11 16:07:15 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e could not be found. Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e could not be found. Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e could not be found. Apr 11 16:07:15 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:07:15 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-252d50f6-39a2-4f5e-96cf-eafc45d50162 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Returning 404 to user: Instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e could not be found. {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 16:07:15 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-252d50f6-39a2-4f5e-96cf-eafc45d50162 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e" status: 404 len: 111 microversion: 2.1 time: 0.026684 Apr 11 16:07:15 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 348/1050] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:07:15 2023] GET /compute/v2.1/servers/0d6c5972-e53b-47e9-8f13-7df1ad86020e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:07:27 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:07:27 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:07:27 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-33028f9b-6642-4dd4-ae43-1f5b47327773 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Action: 'create', calling method: .version_select at 0x7f4c2ec57e20>, body: {"keypair": {"name": "tempest-keypair-1339074440", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZlx+pLUniXvWrJxlxiw5Q+BoJuFNLs4p2kBVBWKeduQ8+tLSOSPSY9wKUYy0gnOh+MHugFjOkVfE6Zpf/rtzSv/FPhR8I4RBXImWMlF3W7sSu4IRSYaCGk6aSma3hmjA=="}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:07:27 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-33028f9b-6642-4dd4-ae43-1f5b47327773 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Getting quotas for project 6241b8bab90c4f1991413b84c5241baf. Resources: {'key_pairs'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:07:27 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-33028f9b-6642-4dd4-ae43-1f5b47327773 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Getting quotas for user 1332668b568e41a98bb68f6c28c92db9 and project 6241b8bab90c4f1991413b84c5241baf. Resources: {'key_pairs'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:07:27 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-33028f9b-6642-4dd4-ae43-1f5b47327773 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.156708 Apr 11 16:07:27 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 350/1051] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 16:07:27 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:07:28 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:07:28 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:07:28 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1014812344", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "c3def4c9-33a3-48eb-ad5c-45bb499758ae"}], "security_groups": [{"name": "tempest-securitygroup--788454"}], "key_name": "tempest-keypair-1339074440", "user_data": "}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:07:28 user devstack@n-api.service[61167]: DEBUG nova.network.neutron [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] validate_networks() for [('c3def4c9-33a3-48eb-ad5c-45bb499758ae', None, None, None, None, None)] {{(pid=61167) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 16:07:29 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Flavor limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 16:07:29 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Image limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 16:07:29 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Flavor pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 16:07:29 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Image pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 16:07:29 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 16:07:29 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:07:29 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:07:29 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:07:29 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:07:29 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:07:29 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:07:29 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Getting quotas for project 6241b8bab90c4f1991413b84c5241baf. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:07:29 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Getting quotas for user 1332668b568e41a98bb68f6c28c92db9 and project 6241b8bab90c4f1991413b84c5241baf. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:07:29 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Going to run 1 instances... {{(pid=61167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 16:07:29 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52fe638c-5ada-47d5-b376-233bfa808a37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 16:07:29 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 396 microversion: 2.1 time: 0.611302 Apr 11 16:07:29 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 354/1052] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 16:07:28 2023] POST /compute/v2.1/servers => generated 396 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 16:07:29 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-cac44232-55c1-4b06-8ee3-bb852dfeb5fe tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:07:29 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-cac44232-55c1-4b06-8ee3-bb852dfeb5fe tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:07:29 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:07:29 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:07:29 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-cac44232-55c1-4b06-8ee3-bb852dfeb5fe tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1332668b568e41a98bb68f6c28c92db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6241b8bab90c4f1991413b84c5241baf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 16:07:29 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-cac44232-55c1-4b06-8ee3-bb852dfeb5fe tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f0473cd-bfe6-4b1c-83d0-6ede26811743" status: 200 len: 1236 microversion: 2.1 time: 0.089888 Apr 11 16:07:29 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 349/1053] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:07:29 2023] GET /compute/v2.1/servers/9f0473cd-bfe6-4b1c-83d0-6ede26811743 => generated 1236 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:07:31 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-8fe54422-666d-4e3a-a866-44c013814d52 req-2ebb8a1f-33da-4b30-9ece-6f435513a367 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f0473cd-bfe6-4b1c-83d0-6ede26811743", "tag": "44472973-4f12-49d0-bab1-930a57c5a234"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:07:31 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-8fe54422-666d-4e3a-a866-44c013814d52 req-2ebb8a1f-33da-4b30-9ece-6f435513a367 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:07:31 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-8fe54422-666d-4e3a-a866-44c013814d52 req-2ebb8a1f-33da-4b30-9ece-6f435513a367 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:07:31 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-8fe54422-666d-4e3a-a866-44c013814d52 req-2ebb8a1f-33da-4b30-9ece-6f435513a367 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:07:31 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-8fe54422-666d-4e3a-a866-44c013814d52 req-2ebb8a1f-33da-4b30-9ece-6f435513a367 service nova] Creating event network-changed:44472973-4f12-49d0-bab1-930a57c5a234 for instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 on user Apr 11 16:07:31 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-8fe54422-666d-4e3a-a866-44c013814d52 req-2ebb8a1f-33da-4b30-9ece-6f435513a367 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032158 Apr 11 16:07:31 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 351/1054] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:07:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:07:33 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-e18411cf-b91c-4645-8db3-db1b72b69a26 req-6b51e081-15cc-407c-8917-b0e90d2cdc53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f0473cd-bfe6-4b1c-83d0-6ede26811743", "name": "network-vif-plugged", "status": "completed", "tag": "44472973-4f12-49d0-bab1-930a57c5a234"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:07:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-e18411cf-b91c-4645-8db3-db1b72b69a26 req-6b51e081-15cc-407c-8917-b0e90d2cdc53 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:07:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-e18411cf-b91c-4645-8db3-db1b72b69a26 req-6b51e081-15cc-407c-8917-b0e90d2cdc53 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:07:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-e18411cf-b91c-4645-8db3-db1b72b69a26 req-6b51e081-15cc-407c-8917-b0e90d2cdc53 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:07:33 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-e18411cf-b91c-4645-8db3-db1b72b69a26 req-6b51e081-15cc-407c-8917-b0e90d2cdc53 service nova] Creating event network-vif-plugged:44472973-4f12-49d0-bab1-930a57c5a234 for instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 on user Apr 11 16:07:33 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-e18411cf-b91c-4645-8db3-db1b72b69a26 req-6b51e081-15cc-407c-8917-b0e90d2cdc53 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086761 Apr 11 16:07:33 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 355/1055] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:07:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:07:35 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-11b5e168-c73a-4adb-880d-aa8d6e77214e req-fe9be200-6e7c-48de-a6e3-0ef1d3dbf70a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f0473cd-bfe6-4b1c-83d0-6ede26811743", "name": "network-vif-plugged", "status": "completed", "tag": "44472973-4f12-49d0-bab1-930a57c5a234"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:07:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-11b5e168-c73a-4adb-880d-aa8d6e77214e req-fe9be200-6e7c-48de-a6e3-0ef1d3dbf70a service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:07:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-11b5e168-c73a-4adb-880d-aa8d6e77214e req-fe9be200-6e7c-48de-a6e3-0ef1d3dbf70a service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:07:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-11b5e168-c73a-4adb-880d-aa8d6e77214e req-fe9be200-6e7c-48de-a6e3-0ef1d3dbf70a service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:07:35 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-11b5e168-c73a-4adb-880d-aa8d6e77214e req-fe9be200-6e7c-48de-a6e3-0ef1d3dbf70a service nova] Creating event network-vif-plugged:44472973-4f12-49d0-bab1-930a57c5a234 for instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 on user Apr 11 16:07:35 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-11b5e168-c73a-4adb-880d-aa8d6e77214e req-fe9be200-6e7c-48de-a6e3-0ef1d3dbf70a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039478 Apr 11 16:07:35 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 350/1056] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:07:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:08:19 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:08:19 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:08:19 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:08:19 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-1ba28890-a3ee-48cd-bc41-f37144ec49d3 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:08:19 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-1ba28890-a3ee-48cd-bc41-f37144ec49d3 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:08:19 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-1ba28890-a3ee-48cd-bc41-f37144ec49d3 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:08:19 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-1ba28890-a3ee-48cd-bc41-f37144ec49d3 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:08:19 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-1ba28890-a3ee-48cd-bc41-f37144ec49d3 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:08:19 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-1ba28890-a3ee-48cd-bc41-f37144ec49d3 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:08:19 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-1ba28890-a3ee-48cd-bc41-f37144ec49d3 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:08:19 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-1ba28890-a3ee-48cd-bc41-f37144ec49d3 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:08:19 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-1ba28890-a3ee-48cd-bc41-f37144ec49d3 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1332668b568e41a98bb68f6c28c92db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6241b8bab90c4f1991413b84c5241baf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 16:08:19 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-1ba28890-a3ee-48cd-bc41-f37144ec49d3 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f0473cd-bfe6-4b1c-83d0-6ede26811743" status: 200 len: 1543 microversion: 2.1 time: 0.220519 Apr 11 16:08:19 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 352/1057] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:08:19 2023] GET /compute/v2.1/servers/9f0473cd-bfe6-4b1c-83d0-6ede26811743 => generated 1543 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:09:19 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:09:19 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:09:19 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:09:19 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=4 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:09:19 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-7ecc7878-67e6-4b5e-ad26-0a3f8570686f tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:09:19 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-7ecc7878-67e6-4b5e-ad26-0a3f8570686f tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:09:19 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7ecc7878-67e6-4b5e-ad26-0a3f8570686f tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:09:19 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7ecc7878-67e6-4b5e-ad26-0a3f8570686f tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:09:19 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7ecc7878-67e6-4b5e-ad26-0a3f8570686f tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:09:19 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7ecc7878-67e6-4b5e-ad26-0a3f8570686f tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:09:19 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7ecc7878-67e6-4b5e-ad26-0a3f8570686f tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:09:19 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-7ecc7878-67e6-4b5e-ad26-0a3f8570686f tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:09:19 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-7ecc7878-67e6-4b5e-ad26-0a3f8570686f tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f0473cd-bfe6-4b1c-83d0-6ede26811743/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.148473 Apr 11 16:09:19 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 356/1058] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 16:09:19 2023] GET /compute/v2.1/servers/9f0473cd-bfe6-4b1c-83d0-6ede26811743/os-interface => generated 283 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:09:20 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:09:20 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:09:20 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:09:20 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-486200ef-df9d-4a72-959b-42132e8653ec req-27e40445-9e07-4908-bda8-7cb372382f08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f0473cd-bfe6-4b1c-83d0-6ede26811743", "tag": "44472973-4f12-49d0-bab1-930a57c5a234"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:09:20 user devstack@n-api.service[61165]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2290b1d4-22a2-492c-8aed-024685845370] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 11 16:09:20 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:09:20 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:09:20 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-6ec15594-60f2-4efc-9ffc-ef8a88a3ffa3 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:09:20 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-6ec15594-60f2-4efc-9ffc-ef8a88a3ffa3 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:09:20 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-6ec15594-60f2-4efc-9ffc-ef8a88a3ffa3 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:09:20 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-6ec15594-60f2-4efc-9ffc-ef8a88a3ffa3 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:09:20 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-6ec15594-60f2-4efc-9ffc-ef8a88a3ffa3 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:09:20 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-6ec15594-60f2-4efc-9ffc-ef8a88a3ffa3 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:09:20 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-6ec15594-60f2-4efc-9ffc-ef8a88a3ffa3 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:09:20 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-6ec15594-60f2-4efc-9ffc-ef8a88a3ffa3 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:09:20 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-486200ef-df9d-4a72-959b-42132e8653ec req-27e40445-9e07-4908-bda8-7cb372382f08 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:09:20 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-486200ef-df9d-4a72-959b-42132e8653ec req-27e40445-9e07-4908-bda8-7cb372382f08 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:09:20 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-486200ef-df9d-4a72-959b-42132e8653ec req-27e40445-9e07-4908-bda8-7cb372382f08 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:09:20 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-6ec15594-60f2-4efc-9ffc-ef8a88a3ffa3 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f0473cd-bfe6-4b1c-83d0-6ede26811743/ips" status: 200 len: 109 microversion: 2.1 time: 0.043758 Apr 11 16:09:20 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 353/1059] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 16:09:20 2023] GET /compute/v2.1/servers/9f0473cd-bfe6-4b1c-83d0-6ede26811743/ips => generated 109 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:09:20 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-486200ef-df9d-4a72-959b-42132e8653ec req-27e40445-9e07-4908-bda8-7cb372382f08 service nova] Creating event network-changed:44472973-4f12-49d0-bab1-930a57c5a234 for instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 on user Apr 11 16:09:20 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-486200ef-df9d-4a72-959b-42132e8653ec req-27e40445-9e07-4908-bda8-7cb372382f08 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133947 Apr 11 16:09:20 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 351/1060] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:09:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:09:22 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f728a0e1-861e-4f16-9255-fedbc1830b37"}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:09:22 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:09:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:09:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:09:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:09:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:09:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:09:22 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:09:22 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9f0473cd-bfe6-4b1c-83d0-6ede26811743/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.345269 Apr 11 16:09:22 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 357/1061] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 16:09:22 2023] POST /compute/v2.1/servers/9f0473cd-bfe6-4b1c-83d0-6ede26811743/os-volume_attachments => generated 194 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:09:29 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-269834c4-7298-4a98-9b1d-30aaa8714509 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Action: 'create', calling method: .version_select at 0x7f4c2ef2f010>, body: {"keypair": {"name": "tempest-keypair-1619440901", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhwj5HGj4LqkFfhM3prw807GjlwL3+JFQFZdekOyHjeT6jf+I7UzZjFvxNMkZVw+IA5tbCxNem0yf/re31E+6LVdriMcJRoLpLI3OEdeLdLr+XUaVEpcYXyKT5L8RhAlw=="}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:09:29 user devstack@n-api.service[61165]: INFO oslo.messaging._drivers.impl_rabbit [-] [2290b1d4-22a2-492c-8aed-024685845370] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 47332. Apr 11 16:09:29 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-269834c4-7298-4a98-9b1d-30aaa8714509 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Getting quotas for project 6241b8bab90c4f1991413b84c5241baf. Resources: {'key_pairs'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:09:29 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-269834c4-7298-4a98-9b1d-30aaa8714509 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Getting quotas for user 1332668b568e41a98bb68f6c28c92db9 and project 6241b8bab90c4f1991413b84c5241baf. Resources: {'key_pairs'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:09:29 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-269834c4-7298-4a98-9b1d-30aaa8714509 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055233 Apr 11 16:09:29 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 354/1062] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 16:09:29 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:09:30 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-874375628", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "c3def4c9-33a3-48eb-ad5c-45bb499758ae"}], "security_groups": [{"name": "tempest-securitygroup--486542531"}], "key_name": "tempest-keypair-1619440901", "user_data": "}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:09:30 user devstack@n-api.service[61166]: DEBUG nova.network.neutron [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] validate_networks() for [('c3def4c9-33a3-48eb-ad5c-45bb499758ae', None, None, None, None, None)] {{(pid=61166) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 16:09:30 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:09:31 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Flavor limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 16:09:31 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Image limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 16:09:31 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Flavor pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 16:09:31 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Image pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 16:09:31 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 16:09:31 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:09:31 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:09:31 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:09:31 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:09:31 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:09:31 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:09:31 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Getting quotas for project 6241b8bab90c4f1991413b84c5241baf. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:09:31 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Getting quotas for user 1332668b568e41a98bb68f6c28c92db9 and project 6241b8bab90c4f1991413b84c5241baf. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:09:31 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Going to run 1 instances... {{(pid=61166) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 16:09:31 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52fe638c-5ada-47d5-b376-233bfa808a37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 16:09:31 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.608845 Apr 11 16:09:31 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 352/1063] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 16:09:30 2023] POST /compute/v2.1/servers => generated 399 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 16:09:31 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-513e9ea1-ac71-451b-922b-8c4ca4edfddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:09:31 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-513e9ea1-ac71-451b-922b-8c4ca4edfddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:09:31 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-513e9ea1-ac71-451b-922b-8c4ca4edfddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1332668b568e41a98bb68f6c28c92db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6241b8bab90c4f1991413b84c5241baf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 16:09:31 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-513e9ea1-ac71-451b-922b-8c4ca4edfddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6e7aedb-2302-467e-83ea-07584c5b86ff" status: 200 len: 1235 microversion: 2.1 time: 0.074074 Apr 11 16:09:31 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 358/1064] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:09:31 2023] GET /compute/v2.1/servers/d6e7aedb-2302-467e-83ea-07584c5b86ff => generated 1235 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:09:33 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:09:33 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-c50ea4e4-9612-4732-afc7-21fb81129d03 req-1ea79cc5-d3bd-4078-8686-c0050c552a54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6e7aedb-2302-467e-83ea-07584c5b86ff", "tag": "02de7a0f-1b41-4535-9edc-ea84c6b14447"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:09:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-c50ea4e4-9612-4732-afc7-21fb81129d03 req-1ea79cc5-d3bd-4078-8686-c0050c552a54 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:09:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-c50ea4e4-9612-4732-afc7-21fb81129d03 req-1ea79cc5-d3bd-4078-8686-c0050c552a54 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:09:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-c50ea4e4-9612-4732-afc7-21fb81129d03 req-1ea79cc5-d3bd-4078-8686-c0050c552a54 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:09:33 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-c50ea4e4-9612-4732-afc7-21fb81129d03 req-1ea79cc5-d3bd-4078-8686-c0050c552a54 service nova] Creating event network-changed:02de7a0f-1b41-4535-9edc-ea84c6b14447 for instance d6e7aedb-2302-467e-83ea-07584c5b86ff on user Apr 11 16:09:33 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-c50ea4e4-9612-4732-afc7-21fb81129d03 req-1ea79cc5-d3bd-4078-8686-c0050c552a54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088277 Apr 11 16:09:33 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 355/1065] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:09:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:09:35 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-5fae002d-a9f3-4658-92be-97bbc3771ebf req-9747a70f-3440-4e02-a527-5214215f3beb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6e7aedb-2302-467e-83ea-07584c5b86ff", "name": "network-vif-plugged", "status": "completed", "tag": "02de7a0f-1b41-4535-9edc-ea84c6b14447"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:09:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-5fae002d-a9f3-4658-92be-97bbc3771ebf req-9747a70f-3440-4e02-a527-5214215f3beb service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:09:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-5fae002d-a9f3-4658-92be-97bbc3771ebf req-9747a70f-3440-4e02-a527-5214215f3beb service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:09:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-5fae002d-a9f3-4658-92be-97bbc3771ebf req-9747a70f-3440-4e02-a527-5214215f3beb service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:09:35 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-5fae002d-a9f3-4658-92be-97bbc3771ebf req-9747a70f-3440-4e02-a527-5214215f3beb service nova] Creating event network-vif-plugged:02de7a0f-1b41-4535-9edc-ea84c6b14447 for instance d6e7aedb-2302-467e-83ea-07584c5b86ff on user Apr 11 16:09:35 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-5fae002d-a9f3-4658-92be-97bbc3771ebf req-9747a70f-3440-4e02-a527-5214215f3beb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032858 Apr 11 16:09:35 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 353/1066] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:09:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:09:37 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:09:37 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-d2f74545-4f18-4eeb-8652-bec78024cb5f req-43613003-83c7-48ff-a729-2605f5eec32e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6e7aedb-2302-467e-83ea-07584c5b86ff", "name": "network-vif-plugged", "status": "completed", "tag": "02de7a0f-1b41-4535-9edc-ea84c6b14447"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:09:37 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-d2f74545-4f18-4eeb-8652-bec78024cb5f req-43613003-83c7-48ff-a729-2605f5eec32e service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:09:37 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-d2f74545-4f18-4eeb-8652-bec78024cb5f req-43613003-83c7-48ff-a729-2605f5eec32e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:09:37 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-d2f74545-4f18-4eeb-8652-bec78024cb5f req-43613003-83c7-48ff-a729-2605f5eec32e service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:09:37 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-d2f74545-4f18-4eeb-8652-bec78024cb5f req-43613003-83c7-48ff-a729-2605f5eec32e service nova] Creating event network-vif-plugged:02de7a0f-1b41-4535-9edc-ea84c6b14447 for instance d6e7aedb-2302-467e-83ea-07584c5b86ff on user Apr 11 16:09:37 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-d2f74545-4f18-4eeb-8652-bec78024cb5f req-43613003-83c7-48ff-a729-2605f5eec32e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037983 Apr 11 16:09:37 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 359/1067] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:09:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:10:21 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:10:21 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:10:21 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:10:21 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-220a4cfe-48d8-4685-91be-eac4ff5076db tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:10:21 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-220a4cfe-48d8-4685-91be-eac4ff5076db tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:10:21 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-220a4cfe-48d8-4685-91be-eac4ff5076db tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:10:21 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-220a4cfe-48d8-4685-91be-eac4ff5076db tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:10:21 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-220a4cfe-48d8-4685-91be-eac4ff5076db tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:10:21 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-220a4cfe-48d8-4685-91be-eac4ff5076db tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:10:21 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-220a4cfe-48d8-4685-91be-eac4ff5076db tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:10:21 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-220a4cfe-48d8-4685-91be-eac4ff5076db tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:10:21 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-220a4cfe-48d8-4685-91be-eac4ff5076db tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1332668b568e41a98bb68f6c28c92db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6241b8bab90c4f1991413b84c5241baf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 16:10:21 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-220a4cfe-48d8-4685-91be-eac4ff5076db tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6e7aedb-2302-467e-83ea-07584c5b86ff" status: 200 len: 1545 microversion: 2.1 time: 0.274965 Apr 11 16:10:21 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 356/1068] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:10:21 2023] GET /compute/v2.1/servers/d6e7aedb-2302-467e-83ea-07584c5b86ff => generated 1545 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:11:21 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:11:21 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:11:21 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:11:21 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:11:21 user devstack@n-api.service[61166]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:11:21 user devstack@n-api.service[61166]: Tue Apr 11 16:11:21 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d6e7aedb-2302-467e-83ea-07584c5b86ff/os-interface (ip 10.0.0.210) !!! Apr 11 16:11:21 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-d1b65a4c-dffc-4010-b609-24203c6f5d0b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:11:21 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-d1b65a4c-dffc-4010-b609-24203c6f5d0b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:11:21 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d1b65a4c-dffc-4010-b609-24203c6f5d0b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:11:21 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d1b65a4c-dffc-4010-b609-24203c6f5d0b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:11:21 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d1b65a4c-dffc-4010-b609-24203c6f5d0b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:11:21 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d1b65a4c-dffc-4010-b609-24203c6f5d0b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:11:21 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d1b65a4c-dffc-4010-b609-24203c6f5d0b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:11:21 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d1b65a4c-dffc-4010-b609-24203c6f5d0b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:11:22 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-d1b65a4c-dffc-4010-b609-24203c6f5d0b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6e7aedb-2302-467e-83ea-07584c5b86ff/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.196402 Apr 11 16:11:22 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 354/1069] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 16:11:21 2023] GET /compute/v2.1/servers/d6e7aedb-2302-467e-83ea-07584c5b86ff/os-interface => generated 283 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:11:23 user devstack@n-api.service[61167]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f5e3bdb2-c95f-470f-b3a7-1902314e275b] AMQP server on 10.0.0.210:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Apr 11 16:11:23 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:11:23 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=10 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:11:23 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:11:23 user devstack@n-api.service[61167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:11:23 user devstack@n-api.service[61167]: Tue Apr 11 16:11:23 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 11 16:11:23 user devstack@n-api.service[61167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:11:23 user devstack@n-api.service[61167]: Tue Apr 11 16:11:23 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 11 16:11:23 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-1d30bf31-2770-4175-a805-d49e7c842716 req-1040a79f-4c82-4eab-98f4-d5da816e33e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6e7aedb-2302-467e-83ea-07584c5b86ff", "tag": "02de7a0f-1b41-4535-9edc-ea84c6b14447"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:11:23 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-1d30bf31-2770-4175-a805-d49e7c842716 req-1040a79f-4c82-4eab-98f4-d5da816e33e4 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:11:23 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-1d30bf31-2770-4175-a805-d49e7c842716 req-1040a79f-4c82-4eab-98f4-d5da816e33e4 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:11:23 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-1d30bf31-2770-4175-a805-d49e7c842716 req-1040a79f-4c82-4eab-98f4-d5da816e33e4 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:11:23 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-1d30bf31-2770-4175-a805-d49e7c842716 req-1040a79f-4c82-4eab-98f4-d5da816e33e4 service nova] Creating event network-changed:02de7a0f-1b41-4535-9edc-ea84c6b14447 for instance d6e7aedb-2302-467e-83ea-07584c5b86ff on user Apr 11 16:11:23 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-1d30bf31-2770-4175-a805-d49e7c842716 req-1040a79f-4c82-4eab-98f4-d5da816e33e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045364 Apr 11 16:11:23 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 360/1070] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:11:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:11:23 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:11:23 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:11:23 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-32f788b4-2cba-48e3-b5f2-6b378d35331e tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:11:23 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-32f788b4-2cba-48e3-b5f2-6b378d35331e tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:11:23 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-32f788b4-2cba-48e3-b5f2-6b378d35331e tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:11:23 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-32f788b4-2cba-48e3-b5f2-6b378d35331e tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:11:23 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-32f788b4-2cba-48e3-b5f2-6b378d35331e tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:11:23 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-32f788b4-2cba-48e3-b5f2-6b378d35331e tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:11:23 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-32f788b4-2cba-48e3-b5f2-6b378d35331e tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:11:23 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-32f788b4-2cba-48e3-b5f2-6b378d35331e tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:11:23 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-32f788b4-2cba-48e3-b5f2-6b378d35331e tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6e7aedb-2302-467e-83ea-07584c5b86ff/ips" status: 200 len: 109 microversion: 2.1 time: 0.042776 Apr 11 16:11:23 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 357/1071] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 16:11:23 2023] GET /compute/v2.1/servers/d6e7aedb-2302-467e-83ea-07584c5b86ff/ips => generated 109 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:11:23 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-c1a1ce6b-9c51-4748-912f-590c0f28b72c tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f728a0e1-861e-4f16-9255-fedbc1830b37"}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:11:23 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-c1a1ce6b-9c51-4748-912f-590c0f28b72c tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:11:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c1a1ce6b-9c51-4748-912f-590c0f28b72c tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:11:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c1a1ce6b-9c51-4748-912f-590c0f28b72c tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:11:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c1a1ce6b-9c51-4748-912f-590c0f28b72c tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:11:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c1a1ce6b-9c51-4748-912f-590c0f28b72c tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:11:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c1a1ce6b-9c51-4748-912f-590c0f28b72c tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:11:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-c1a1ce6b-9c51-4748-912f-590c0f28b72c tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:11:23 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-c1a1ce6b-9c51-4748-912f-590c0f28b72c tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] HTTP exception thrown: Invalid volume: volume f728a0e1-861e-4f16-9255-fedbc1830b37 is already attached to instances: 9f0473cd-bfe6-4b1c-83d0-6ede26811743 Apr 11 16:11:23 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-c1a1ce6b-9c51-4748-912f-590c0f28b72c tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Request method failure captured: Apr 11 16:11:23 user devstack@n-api.service[61166]: request: POST /compute/v2.1/servers/d6e7aedb-2302-467e-83ea-07584c5b86ff/os-volume_attachments HTTP/1.1 Apr 11 16:11:23 user devstack@n-api.service[61166]: Accept: application/json Apr 11 16:11:23 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 16:11:23 user devstack@n-api.service[61166]: Connection: close Apr 11 16:11:23 user devstack@n-api.service[61166]: Content-Length: 74 Apr 11 16:11:23 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 16:11:23 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 16:11:23 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 16:11:23 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 16:11:23 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNYW_L9XPHcG5KwL6GJb3NujGL_MZ0JPbbniXnZG6USwza0gVSkBeTzoWC1TAhtn2kzyHJE9gQeBeHlRXcZGNlDuv-D-5XU-i-C7Lz9sn_3a9pm_8fvd7zmQfA44_cXWAvDPZK4ruikdn_0YxTNjsqLaYSEiEkpcPJuiOTrKhfHHA7-c Apr 11 16:11:23 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 16:11:23 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 16:11:23 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 16:11:23 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 16:11:23 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 16:11:23 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 16:11:23 user devstack@n-api.service[61166]: X-Project-Id: 6241b8bab90c4f1991413b84c5241baf Apr 11 16:11:23 user devstack@n-api.service[61166]: X-Project-Name: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:11:23 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 16:11:23 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 16:11:23 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 16:11:23 user devstack@n-api.service[61166]: X-Tenant: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:11:23 user devstack@n-api.service[61166]: X-Tenant-Id: 6241b8bab90c4f1991413b84c5241baf Apr 11 16:11:23 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:11:23 user devstack@n-api.service[61166]: X-User: tempest-AttachVolumeNegativeTest-537147684-project-member Apr 11 16:11:23 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 16:11:23 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 16:11:23 user devstack@n-api.service[61166]: X-User-Id: 1332668b568e41a98bb68f6c28c92db9 Apr 11 16:11:23 user devstack@n-api.service[61166]: X-User-Name: tempest-AttachVolumeNegativeTest-537147684-project-member Apr 11 16:11:23 user devstack@n-api.service[61166]: Apr 11 16:11:23 user devstack@n-api.service[61166]: {"volumeAttachment": {"volumeId": "f728a0e1-861e-4f16-9255-fedbc1830b37"}} Apr 11 16:11:23 user devstack@n-api.service[61166]: method: > Apr 11 16:11:23 user devstack@n-api.service[61166]: exception: Invalid volume: volume f728a0e1-861e-4f16-9255-fedbc1830b37 is already attached to instances: 9f0473cd-bfe6-4b1c-83d0-6ede26811743 Apr 11 16:11:23 user devstack@n-api.service[61166]: action_args: {'server_id': 'd6e7aedb-2302-467e-83ea-07584c5b86ff', 'body': {'volumeAttachment': {'volumeId': 'f728a0e1-861e-4f16-9255-fedbc1830b37'}}} Apr 11 16:11:23 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f728a0e1-861e-4f16-9255-fedbc1830b37 is already attached to instances: 9f0473cd-bfe6-4b1c-83d0-6ede26811743 Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f728a0e1-861e-4f16-9255-fedbc1830b37 is already attached to instances: 9f0473cd-bfe6-4b1c-83d0-6ede26811743 Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f728a0e1-861e-4f16-9255-fedbc1830b37 is already attached to instances: 9f0473cd-bfe6-4b1c-83d0-6ede26811743 Apr 11 16:11:23 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:11:23 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-c1a1ce6b-9c51-4748-912f-590c0f28b72c tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Returning 400 to user: Invalid volume: volume f728a0e1-861e-4f16-9255-fedbc1830b37 is already attached to instances: 9f0473cd-bfe6-4b1c-83d0-6ede26811743 {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 16:11:23 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-c1a1ce6b-9c51-4748-912f-590c0f28b72c tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d6e7aedb-2302-467e-83ea-07584c5b86ff/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.118225 Apr 11 16:11:23 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 355/1072] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 16:11:23 2023] POST /compute/v2.1/servers/d6e7aedb-2302-467e-83ea-07584c5b86ff/os-volume_attachments => generated 174 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 16:11:23 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:11:23 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:11:23 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:11:23 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:11:23 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:11:23 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:11:23 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:11:23 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:11:23 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Going to try to terminate instance {{(pid=61167) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 16:11:23 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d6e7aedb-2302-467e-83ea-07584c5b86ff" status: 204 len: 0 microversion: 2.1 time: 0.120813 Apr 11 16:11:23 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 361/1073] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 16:11:23 2023] DELETE /compute/v2.1/servers/d6e7aedb-2302-467e-83ea-07584c5b86ff => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 16:11:23 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-b65341f4-c8ba-4d30-9aaf-a344fb019165 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:11:23 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-b65341f4-c8ba-4d30-9aaf-a344fb019165 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:11:23 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b65341f4-c8ba-4d30-9aaf-a344fb019165 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:11:23 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b65341f4-c8ba-4d30-9aaf-a344fb019165 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:11:23 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b65341f4-c8ba-4d30-9aaf-a344fb019165 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:11:23 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b65341f4-c8ba-4d30-9aaf-a344fb019165 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:11:23 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b65341f4-c8ba-4d30-9aaf-a344fb019165 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:11:23 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-b65341f4-c8ba-4d30-9aaf-a344fb019165 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:11:23 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-b65341f4-c8ba-4d30-9aaf-a344fb019165 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1332668b568e41a98bb68f6c28c92db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6241b8bab90c4f1991413b84c5241baf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 16:11:23 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-b65341f4-c8ba-4d30-9aaf-a344fb019165 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6e7aedb-2302-467e-83ea-07584c5b86ff" status: 200 len: 1551 microversion: 2.1 time: 0.182421 Apr 11 16:11:23 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 358/1074] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:11:23 2023] GET /compute/v2.1/servers/d6e7aedb-2302-467e-83ea-07584c5b86ff => generated 1551 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:11:23 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-68737f62-b617-4b98-bc97-e13389119f4b req-ad62fb6f-b09a-4e9f-bebb-1483a5574341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6e7aedb-2302-467e-83ea-07584c5b86ff", "name": "network-vif-unplugged", "status": "completed", "tag": "02de7a0f-1b41-4535-9edc-ea84c6b14447"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:11:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-68737f62-b617-4b98-bc97-e13389119f4b req-ad62fb6f-b09a-4e9f-bebb-1483a5574341 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:11:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-68737f62-b617-4b98-bc97-e13389119f4b req-ad62fb6f-b09a-4e9f-bebb-1483a5574341 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:11:23 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-68737f62-b617-4b98-bc97-e13389119f4b req-ad62fb6f-b09a-4e9f-bebb-1483a5574341 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:11:23 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-68737f62-b617-4b98-bc97-e13389119f4b req-ad62fb6f-b09a-4e9f-bebb-1483a5574341 service nova] Creating event network-vif-unplugged:02de7a0f-1b41-4535-9edc-ea84c6b14447 for instance d6e7aedb-2302-467e-83ea-07584c5b86ff on user Apr 11 16:11:23 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-68737f62-b617-4b98-bc97-e13389119f4b req-ad62fb6f-b09a-4e9f-bebb-1483a5574341 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031932 Apr 11 16:11:23 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 356/1075] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:11:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:11:25 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-3f9151ad-ed53-4dd9-8785-2d2e5b8952ad req-6b4bd80a-2bd3-4158-a35f-be0cf6a0936c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6e7aedb-2302-467e-83ea-07584c5b86ff", "name": "network-vif-plugged", "status": "completed", "tag": "02de7a0f-1b41-4535-9edc-ea84c6b14447"}, {"server_uuid": "d6e7aedb-2302-467e-83ea-07584c5b86ff", "name": "network-vif-deleted", "tag": "02de7a0f-1b41-4535-9edc-ea84c6b14447"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:11:25 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-3f9151ad-ed53-4dd9-8785-2d2e5b8952ad req-6b4bd80a-2bd3-4158-a35f-be0cf6a0936c service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:11:25 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-3f9151ad-ed53-4dd9-8785-2d2e5b8952ad req-6b4bd80a-2bd3-4158-a35f-be0cf6a0936c service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:11:25 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-3f9151ad-ed53-4dd9-8785-2d2e5b8952ad req-6b4bd80a-2bd3-4158-a35f-be0cf6a0936c service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:11:25 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-3f9151ad-ed53-4dd9-8785-2d2e5b8952ad req-6b4bd80a-2bd3-4158-a35f-be0cf6a0936c service nova] Creating event network-vif-plugged:02de7a0f-1b41-4535-9edc-ea84c6b14447 for instance d6e7aedb-2302-467e-83ea-07584c5b86ff on user Apr 11 16:11:25 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-3f9151ad-ed53-4dd9-8785-2d2e5b8952ad req-6b4bd80a-2bd3-4158-a35f-be0cf6a0936c service nova] Creating event network-vif-deleted:02de7a0f-1b41-4535-9edc-ea84c6b14447 for instance d6e7aedb-2302-467e-83ea-07584c5b86ff on user Apr 11 16:11:25 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-3f9151ad-ed53-4dd9-8785-2d2e5b8952ad req-6b4bd80a-2bd3-4158-a35f-be0cf6a0936c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030317 Apr 11 16:11:25 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 362/1076] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:11:25 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:12:13 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-25da4393-698d-4c82-b66f-039c97062249 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:12:13 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-25da4393-698d-4c82-b66f-039c97062249 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:12:13 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:12:13 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=10 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:12:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-25da4393-698d-4c82-b66f-039c97062249 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:12:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-25da4393-698d-4c82-b66f-039c97062249 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:12:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-25da4393-698d-4c82-b66f-039c97062249 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:12:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-25da4393-698d-4c82-b66f-039c97062249 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:12:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-25da4393-698d-4c82-b66f-039c97062249 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:12:13 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-25da4393-698d-4c82-b66f-039c97062249 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:12:13 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-25da4393-698d-4c82-b66f-039c97062249 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] HTTP exception thrown: Instance d6e7aedb-2302-467e-83ea-07584c5b86ff could not be found. Apr 11 16:12:13 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-25da4393-698d-4c82-b66f-039c97062249 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Request method failure captured: Apr 11 16:12:13 user devstack@n-api.service[61165]: request: GET /compute/v2.1/servers/d6e7aedb-2302-467e-83ea-07584c5b86ff HTTP/1.1 Apr 11 16:12:13 user devstack@n-api.service[61165]: Accept: application/json Apr 11 16:12:13 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 16:12:13 user devstack@n-api.service[61165]: Connection: close Apr 11 16:12:13 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 16:12:13 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 16:12:13 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 16:12:13 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 16:12:13 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 16:12:13 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNYW_L9XPHcG5KwL6GJb3NujGL_MZ0JPbbniXnZG6USwza0gVSkBeTzoWC1TAhtn2kzyHJE9gQeBeHlRXcZGNlDuv-D-5XU-i-C7Lz9sn_3a9pm_8fvd7zmQfA44_cXWAvDPZK4ruikdn_0YxTNjsqLaYSEiEkpcPJuiOTrKhfHHA7-c Apr 11 16:12:13 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 16:12:13 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 16:12:13 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 16:12:13 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 16:12:13 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 16:12:13 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 16:12:13 user devstack@n-api.service[61165]: X-Project-Id: 6241b8bab90c4f1991413b84c5241baf Apr 11 16:12:13 user devstack@n-api.service[61165]: X-Project-Name: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:12:13 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 16:12:13 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 16:12:13 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 16:12:13 user devstack@n-api.service[61165]: X-Tenant: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:12:13 user devstack@n-api.service[61165]: X-Tenant-Id: 6241b8bab90c4f1991413b84c5241baf Apr 11 16:12:13 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:12:13 user devstack@n-api.service[61165]: X-User: tempest-AttachVolumeNegativeTest-537147684-project-member Apr 11 16:12:13 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 16:12:13 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 16:12:13 user devstack@n-api.service[61165]: X-User-Id: 1332668b568e41a98bb68f6c28c92db9 Apr 11 16:12:13 user devstack@n-api.service[61165]: X-User-Name: tempest-AttachVolumeNegativeTest-537147684-project-member Apr 11 16:12:13 user devstack@n-api.service[61165]: method: > Apr 11 16:12:13 user devstack@n-api.service[61165]: exception: Instance d6e7aedb-2302-467e-83ea-07584c5b86ff could not be found. Apr 11 16:12:13 user devstack@n-api.service[61165]: action_args: {'id': 'd6e7aedb-2302-467e-83ea-07584c5b86ff'} Apr 11 16:12:13 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6e7aedb-2302-467e-83ea-07584c5b86ff could not be found. Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6e7aedb-2302-467e-83ea-07584c5b86ff could not be found. Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6e7aedb-2302-467e-83ea-07584c5b86ff could not be found. Apr 11 16:12:13 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:12:13 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-25da4393-698d-4c82-b66f-039c97062249 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Returning 404 to user: Instance d6e7aedb-2302-467e-83ea-07584c5b86ff could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 16:12:13 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-25da4393-698d-4c82-b66f-039c97062249 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6e7aedb-2302-467e-83ea-07584c5b86ff" status: 404 len: 111 microversion: 2.1 time: 0.036741 Apr 11 16:12:13 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 359/1077] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:12:13 2023] GET /compute/v2.1/servers/d6e7aedb-2302-467e-83ea-07584c5b86ff => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:12:13 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-ca1e31cd-abbc-4931-b064-0918e8b5c62d tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '.version_select at 0x7f4c2edf5d80>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:12:13 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:12:13 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=12 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:12:13 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-ca1e31cd-abbc-4931-b064-0918e8b5c62d tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1619440901" status: 202 len: 0 microversion: 2.1 time: 0.039757 Apr 11 16:12:13 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 357/1078] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 16:12:13 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1619440901 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:12:14 user devstack@n-api.service[61167]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f5e3bdb2-c95f-470f-b3a7-1902314e275b] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 11 16:12:14 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:12:14 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:12:14 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:12:14 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:12:14 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:12:14 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:12:14 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:12:14 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:12:14 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:12:14 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:12:14 user devstack@n-api.service[61167]: DEBUG nova.objects.instance [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lazy-loading 'services' on Instance uuid 9f0473cd-bfe6-4b1c-83d0-6ede26811743 {{(pid=61167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 16:12:14 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9f0473cd-bfe6-4b1c-83d0-6ede26811743/os-volume_attachments/f728a0e1-861e-4f16-9255-fedbc1830b37" status: 202 len: 0 microversion: 2.1 time: 0.170493 Apr 11 16:12:14 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 363/1079] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 16:12:14 2023] DELETE /compute/v2.1/servers/9f0473cd-bfe6-4b1c-83d0-6ede26811743/os-volume_attachments/f728a0e1-861e-4f16-9255-fedbc1830b37 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:12:14 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-aee9ce20-131c-43ed-93eb-b8ea76693411 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:12:14 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-aee9ce20-131c-43ed-93eb-b8ea76693411 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:12:14 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-aee9ce20-131c-43ed-93eb-b8ea76693411 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:12:14 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-aee9ce20-131c-43ed-93eb-b8ea76693411 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:12:14 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-aee9ce20-131c-43ed-93eb-b8ea76693411 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:12:14 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-aee9ce20-131c-43ed-93eb-b8ea76693411 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:12:14 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-aee9ce20-131c-43ed-93eb-b8ea76693411 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:12:14 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-aee9ce20-131c-43ed-93eb-b8ea76693411 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:12:14 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-aee9ce20-131c-43ed-93eb-b8ea76693411 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f0473cd-bfe6-4b1c-83d0-6ede26811743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052150 Apr 11 16:12:14 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 360/1080] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 16:12:14 2023] GET /compute/v2.1/servers/9f0473cd-bfe6-4b1c-83d0-6ede26811743/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 16:13:04 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:13:05 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-d9da51ce-36b5-49bf-8d06-8b4cce7ed121 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:13:05 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-d9da51ce-36b5-49bf-8d06-8b4cce7ed121 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:13:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d9da51ce-36b5-49bf-8d06-8b4cce7ed121 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:13:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d9da51ce-36b5-49bf-8d06-8b4cce7ed121 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:13:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d9da51ce-36b5-49bf-8d06-8b4cce7ed121 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:13:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d9da51ce-36b5-49bf-8d06-8b4cce7ed121 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:13:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d9da51ce-36b5-49bf-8d06-8b4cce7ed121 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:13:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d9da51ce-36b5-49bf-8d06-8b4cce7ed121 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:13:05 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-d9da51ce-36b5-49bf-8d06-8b4cce7ed121 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f0473cd-bfe6-4b1c-83d0-6ede26811743/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.121852 Apr 11 16:13:05 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 358/1081] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 16:13:04 2023] GET /compute/v2.1/servers/9f0473cd-bfe6-4b1c-83d0-6ede26811743/os-volume_attachments => generated 25 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 16:13:05 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:13:05 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:13:05 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:13:05 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:13:05 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:13:05 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:13:05 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:13:05 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:13:05 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:13:05 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:13:05 user devstack@n-api.service[61167]: INFO oslo.messaging._drivers.impl_rabbit [-] [f5e3bdb2-c95f-470f-b3a7-1902314e275b] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 57782. Apr 11 16:13:05 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Going to try to terminate instance {{(pid=61167) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 16:13:05 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9f0473cd-bfe6-4b1c-83d0-6ede26811743" status: 204 len: 0 microversion: 2.1 time: 0.133046 Apr 11 16:13:05 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 364/1082] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 16:13:05 2023] DELETE /compute/v2.1/servers/9f0473cd-bfe6-4b1c-83d0-6ede26811743 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 16:13:05 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-627ccaf3-8203-4079-a453-985a338a89f5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:13:05 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-627ccaf3-8203-4079-a453-985a338a89f5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:13:05 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:13:05 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=8 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:13:05 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-627ccaf3-8203-4079-a453-985a338a89f5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:13:05 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-627ccaf3-8203-4079-a453-985a338a89f5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:13:05 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-627ccaf3-8203-4079-a453-985a338a89f5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:13:05 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-627ccaf3-8203-4079-a453-985a338a89f5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:13:05 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-627ccaf3-8203-4079-a453-985a338a89f5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:13:05 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-627ccaf3-8203-4079-a453-985a338a89f5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:13:05 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-627ccaf3-8203-4079-a453-985a338a89f5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1332668b568e41a98bb68f6c28c92db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6241b8bab90c4f1991413b84c5241baf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 16:13:05 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-627ccaf3-8203-4079-a453-985a338a89f5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f0473cd-bfe6-4b1c-83d0-6ede26811743" status: 200 len: 1667 microversion: 2.1 time: 0.203401 Apr 11 16:13:05 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 361/1083] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:13:05 2023] GET /compute/v2.1/servers/9f0473cd-bfe6-4b1c-83d0-6ede26811743 => generated 1667 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:13:05 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-26b96ea8-037d-4326-a798-1c815eb7e2e3 req-0058357d-2590-4ae5-b0a8-c484e23cc87d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f0473cd-bfe6-4b1c-83d0-6ede26811743", "name": "network-vif-unplugged", "status": "completed", "tag": "44472973-4f12-49d0-bab1-930a57c5a234"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:13:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-26b96ea8-037d-4326-a798-1c815eb7e2e3 req-0058357d-2590-4ae5-b0a8-c484e23cc87d service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:13:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-26b96ea8-037d-4326-a798-1c815eb7e2e3 req-0058357d-2590-4ae5-b0a8-c484e23cc87d service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:13:05 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-26b96ea8-037d-4326-a798-1c815eb7e2e3 req-0058357d-2590-4ae5-b0a8-c484e23cc87d service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:13:05 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-26b96ea8-037d-4326-a798-1c815eb7e2e3 req-0058357d-2590-4ae5-b0a8-c484e23cc87d service nova] Creating event network-vif-unplugged:44472973-4f12-49d0-bab1-930a57c5a234 for instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 on user Apr 11 16:13:05 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-26b96ea8-037d-4326-a798-1c815eb7e2e3 req-0058357d-2590-4ae5-b0a8-c484e23cc87d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092937 Apr 11 16:13:05 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 359/1084] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:13:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:13:06 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-e43627a2-5446-4f45-8b72-559ade087684 req-c47afbe7-f0b1-45eb-8059-e939a6892ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f0473cd-bfe6-4b1c-83d0-6ede26811743", "name": "network-vif-deleted", "tag": "44472973-4f12-49d0-bab1-930a57c5a234"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:13:06 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-e43627a2-5446-4f45-8b72-559ade087684 req-c47afbe7-f0b1-45eb-8059-e939a6892ffc service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:13:06 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-e43627a2-5446-4f45-8b72-559ade087684 req-c47afbe7-f0b1-45eb-8059-e939a6892ffc service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:13:06 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-e43627a2-5446-4f45-8b72-559ade087684 req-c47afbe7-f0b1-45eb-8059-e939a6892ffc service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:13:06 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-e43627a2-5446-4f45-8b72-559ade087684 req-c47afbe7-f0b1-45eb-8059-e939a6892ffc service nova] Creating event network-vif-deleted:44472973-4f12-49d0-bab1-930a57c5a234 for instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 on user Apr 11 16:13:06 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-e43627a2-5446-4f45-8b72-559ade087684 req-c47afbe7-f0b1-45eb-8059-e939a6892ffc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028369 Apr 11 16:13:06 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 365/1085] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:13:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:13:07 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-961e6315-74d5-4650-be30-024e6c625059 req-e1056120-59be-444a-aba9-d568cb450f10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f0473cd-bfe6-4b1c-83d0-6ede26811743", "name": "network-vif-plugged", "status": "completed", "tag": "44472973-4f12-49d0-bab1-930a57c5a234"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:13:07 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-961e6315-74d5-4650-be30-024e6c625059 req-e1056120-59be-444a-aba9-d568cb450f10 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:13:07 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-961e6315-74d5-4650-be30-024e6c625059 req-e1056120-59be-444a-aba9-d568cb450f10 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:13:07 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-961e6315-74d5-4650-be30-024e6c625059 req-e1056120-59be-444a-aba9-d568cb450f10 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:13:07 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-961e6315-74d5-4650-be30-024e6c625059 req-e1056120-59be-444a-aba9-d568cb450f10 service nova] Creating event network-vif-plugged:44472973-4f12-49d0-bab1-930a57c5a234 for instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 on user Apr 11 16:13:07 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-961e6315-74d5-4650-be30-024e6c625059 req-e1056120-59be-444a-aba9-d568cb450f10 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037492 Apr 11 16:13:07 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 362/1086] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:13:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:13:55 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:13:55 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=8 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:13:55 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-4fc556a3-e478-4c3b-80b5-1482a0bc3f87 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:13:55 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-4fc556a3-e478-4c3b-80b5-1482a0bc3f87 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:13:55 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4fc556a3-e478-4c3b-80b5-1482a0bc3f87 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:13:55 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4fc556a3-e478-4c3b-80b5-1482a0bc3f87 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:13:55 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4fc556a3-e478-4c3b-80b5-1482a0bc3f87 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:13:55 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4fc556a3-e478-4c3b-80b5-1482a0bc3f87 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:13:55 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4fc556a3-e478-4c3b-80b5-1482a0bc3f87 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:13:55 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-4fc556a3-e478-4c3b-80b5-1482a0bc3f87 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:13:55 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-4fc556a3-e478-4c3b-80b5-1482a0bc3f87 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] HTTP exception thrown: Instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 could not be found. Apr 11 16:13:55 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-4fc556a3-e478-4c3b-80b5-1482a0bc3f87 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Request method failure captured: Apr 11 16:13:55 user devstack@n-api.service[61166]: request: GET /compute/v2.1/servers/9f0473cd-bfe6-4b1c-83d0-6ede26811743 HTTP/1.1 Apr 11 16:13:55 user devstack@n-api.service[61166]: Accept: application/json Apr 11 16:13:55 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 16:13:55 user devstack@n-api.service[61166]: Connection: close Apr 11 16:13:55 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 16:13:55 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 16:13:55 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 16:13:55 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 16:13:55 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 16:13:55 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNYW_L9XPHcG5KwL6GJb3NujGL_MZ0JPbbniXnZG6USwza0gVSkBeTzoWC1TAhtn2kzyHJE9gQeBeHlRXcZGNlDuv-D-5XU-i-C7Lz9sn_3a9pm_8fvd7zmQfA44_cXWAvDPZK4ruikdn_0YxTNjsqLaYSEiEkpcPJuiOTrKhfHHA7-c Apr 11 16:13:55 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 16:13:55 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 16:13:55 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 16:13:55 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 16:13:55 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 16:13:55 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 16:13:55 user devstack@n-api.service[61166]: X-Project-Id: 6241b8bab90c4f1991413b84c5241baf Apr 11 16:13:55 user devstack@n-api.service[61166]: X-Project-Name: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:13:55 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 16:13:55 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 16:13:55 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 16:13:55 user devstack@n-api.service[61166]: X-Tenant: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:13:55 user devstack@n-api.service[61166]: X-Tenant-Id: 6241b8bab90c4f1991413b84c5241baf Apr 11 16:13:55 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:13:55 user devstack@n-api.service[61166]: X-User: tempest-AttachVolumeNegativeTest-537147684-project-member Apr 11 16:13:55 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 16:13:55 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 16:13:55 user devstack@n-api.service[61166]: X-User-Id: 1332668b568e41a98bb68f6c28c92db9 Apr 11 16:13:55 user devstack@n-api.service[61166]: X-User-Name: tempest-AttachVolumeNegativeTest-537147684-project-member Apr 11 16:13:55 user devstack@n-api.service[61166]: method: > Apr 11 16:13:55 user devstack@n-api.service[61166]: exception: Instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 could not be found. Apr 11 16:13:55 user devstack@n-api.service[61166]: action_args: {'id': '9f0473cd-bfe6-4b1c-83d0-6ede26811743'} Apr 11 16:13:55 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 could not be found. Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 could not be found. Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 could not be found. Apr 11 16:13:55 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:13:55 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-4fc556a3-e478-4c3b-80b5-1482a0bc3f87 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Returning 404 to user: Instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 could not be found. {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 16:13:55 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-4fc556a3-e478-4c3b-80b5-1482a0bc3f87 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f0473cd-bfe6-4b1c-83d0-6ede26811743" status: 404 len: 111 microversion: 2.1 time: 0.037041 Apr 11 16:13:55 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 360/1087] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:13:55 2023] GET /compute/v2.1/servers/9f0473cd-bfe6-4b1c-83d0-6ede26811743 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:13:55 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:13:55 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:13:55 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-7e96da68-f335-498e-b58d-2a742723dbac tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '.version_select at 0x7f4c2ecd8820>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:13:55 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-7e96da68-f335-498e-b58d-2a742723dbac tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1339074440" status: 202 len: 0 microversion: 2.1 time: 0.039965 Apr 11 16:13:55 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 366/1088] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 16:13:55 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1339074440 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:13:56 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:13:56 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=8 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:13:56 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-f3d47db3-7814-4fb9-b85a-0a32747fc67c tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Action: 'create', calling method: .version_select at 0x7f4c2ecaa680>, body: {"keypair": {"name": "tempest-keypair-1806827597", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyO65adxfnVO95Gl79TghN3BBsPLDFp/eUd08QommzWWwIKtuKJGjj42drTustAaitCK+3fvkqSKUysqopyv7x6I5217CTf1uAlkBGpbqxX4XQl8IocH35tVRtEYrg6Fg=="}} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:13:56 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-f3d47db3-7814-4fb9-b85a-0a32747fc67c tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Getting quotas for project 6241b8bab90c4f1991413b84c5241baf. Resources: {'key_pairs'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:13:56 user devstack@n-api.service[61165]: DEBUG nova.quota [None req-f3d47db3-7814-4fb9-b85a-0a32747fc67c tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Getting quotas for user 1332668b568e41a98bb68f6c28c92db9 and project 6241b8bab90c4f1991413b84c5241baf. Resources: {'key_pairs'} {{(pid=61165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:13:56 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-f3d47db3-7814-4fb9-b85a-0a32747fc67c tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055999 Apr 11 16:13:56 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 363/1089] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 16:13:56 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 16:13:57 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-504159588", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "c3def4c9-33a3-48eb-ad5c-45bb499758ae"}], "security_groups": [{"name": "tempest-securitygroup--2117581132"}], "key_name": "tempest-keypair-1806827597", "user_data": "}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:13:57 user devstack@n-api.service[61166]: DEBUG nova.network.neutron [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] validate_networks() for [('c3def4c9-33a3-48eb-ad5c-45bb499758ae', None, None, None, None, None)] {{(pid=61166) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 16:13:58 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Flavor limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 16:13:58 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Image limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 16:13:58 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Flavor pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 16:13:58 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Image pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 16:13:58 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 16:13:58 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:13:58 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:13:58 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:13:58 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:13:58 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:13:58 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:13:58 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Getting quotas for project 6241b8bab90c4f1991413b84c5241baf. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:13:58 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Getting quotas for user 1332668b568e41a98bb68f6c28c92db9 and project 6241b8bab90c4f1991413b84c5241baf. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:13:58 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Going to run 1 instances... {{(pid=61166) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 16:13:58 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52fe638c-5ada-47d5-b376-233bfa808a37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 16:13:58 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.525642 Apr 11 16:13:58 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 361/1090] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 16:13:57 2023] POST /compute/v2.1/servers => generated 400 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 16:13:58 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-31173d64-e2be-4e7b-aaff-c3aba4d6da63 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:13:58 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-31173d64-e2be-4e7b-aaff-c3aba4d6da63 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:13:58 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-31173d64-e2be-4e7b-aaff-c3aba4d6da63 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1332668b568e41a98bb68f6c28c92db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6241b8bab90c4f1991413b84c5241baf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 16:13:58 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-31173d64-e2be-4e7b-aaff-c3aba4d6da63 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371" status: 200 len: 1235 microversion: 2.1 time: 0.071214 Apr 11 16:13:58 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 367/1091] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:13:58 2023] GET /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371 => generated 1235 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:14:00 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-ec2a0e2e-5f2c-4337-b71b-a5d266848326 req-e5add60f-e6d3-482f-b092-de065b8c3eaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cce5fba0-a0e4-46c1-8388-96a979360371", "tag": "928d0128-648f-46b1-85df-d743f3b9b642"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:14:00 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-ec2a0e2e-5f2c-4337-b71b-a5d266848326 req-e5add60f-e6d3-482f-b092-de065b8c3eaf service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:14:00 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-ec2a0e2e-5f2c-4337-b71b-a5d266848326 req-e5add60f-e6d3-482f-b092-de065b8c3eaf service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:14:00 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-ec2a0e2e-5f2c-4337-b71b-a5d266848326 req-e5add60f-e6d3-482f-b092-de065b8c3eaf service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:14:00 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-ec2a0e2e-5f2c-4337-b71b-a5d266848326 req-e5add60f-e6d3-482f-b092-de065b8c3eaf service nova] Creating event network-changed:928d0128-648f-46b1-85df-d743f3b9b642 for instance cce5fba0-a0e4-46c1-8388-96a979360371 on user Apr 11 16:14:00 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-ec2a0e2e-5f2c-4337-b71b-a5d266848326 req-e5add60f-e6d3-482f-b092-de065b8c3eaf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031352 Apr 11 16:14:00 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 364/1092] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:14:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:14:02 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-faf3a67c-558a-4db3-ab93-2af76fff5aff req-3126e0cc-43a0-4615-922e-95522f51f55a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cce5fba0-a0e4-46c1-8388-96a979360371", "name": "network-vif-plugged", "status": "completed", "tag": "928d0128-648f-46b1-85df-d743f3b9b642"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:14:02 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-faf3a67c-558a-4db3-ab93-2af76fff5aff req-3126e0cc-43a0-4615-922e-95522f51f55a service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:14:02 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-faf3a67c-558a-4db3-ab93-2af76fff5aff req-3126e0cc-43a0-4615-922e-95522f51f55a service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:14:02 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-faf3a67c-558a-4db3-ab93-2af76fff5aff req-3126e0cc-43a0-4615-922e-95522f51f55a service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:14:02 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-faf3a67c-558a-4db3-ab93-2af76fff5aff req-3126e0cc-43a0-4615-922e-95522f51f55a service nova] Creating event network-vif-plugged:928d0128-648f-46b1-85df-d743f3b9b642 for instance cce5fba0-a0e4-46c1-8388-96a979360371 on user Apr 11 16:14:02 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-faf3a67c-558a-4db3-ab93-2af76fff5aff req-3126e0cc-43a0-4615-922e-95522f51f55a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046089 Apr 11 16:14:02 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 362/1093] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:14:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:14:04 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-22d9ea5e-729d-4708-ae53-06dc4ff84089 req-7dbeb4b0-f5d9-4eaf-bc06-e447915612c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cce5fba0-a0e4-46c1-8388-96a979360371", "name": "network-vif-plugged", "status": "completed", "tag": "928d0128-648f-46b1-85df-d743f3b9b642"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:14:04 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-22d9ea5e-729d-4708-ae53-06dc4ff84089 req-7dbeb4b0-f5d9-4eaf-bc06-e447915612c5 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:14:04 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-22d9ea5e-729d-4708-ae53-06dc4ff84089 req-7dbeb4b0-f5d9-4eaf-bc06-e447915612c5 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:14:04 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-22d9ea5e-729d-4708-ae53-06dc4ff84089 req-7dbeb4b0-f5d9-4eaf-bc06-e447915612c5 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:14:04 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-22d9ea5e-729d-4708-ae53-06dc4ff84089 req-7dbeb4b0-f5d9-4eaf-bc06-e447915612c5 service nova] Creating event network-vif-plugged:928d0128-648f-46b1-85df-d743f3b9b642 for instance cce5fba0-a0e4-46c1-8388-96a979360371 on user Apr 11 16:14:04 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-22d9ea5e-729d-4708-ae53-06dc4ff84089 req-7dbeb4b0-f5d9-4eaf-bc06-e447915612c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028970 Apr 11 16:14:04 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 368/1094] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:14:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:14:48 user devstack@n-api.service[61165]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2290b1d4-22a2-492c-8aed-024685845370] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 11 16:14:48 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:14:48 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:14:48 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:14:48 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-ac9d897c-7f9e-4e8d-bd05-3a11fd32cb2b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:14:48 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-ac9d897c-7f9e-4e8d-bd05-3a11fd32cb2b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:14:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ac9d897c-7f9e-4e8d-bd05-3a11fd32cb2b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:14:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ac9d897c-7f9e-4e8d-bd05-3a11fd32cb2b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:14:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ac9d897c-7f9e-4e8d-bd05-3a11fd32cb2b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:14:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ac9d897c-7f9e-4e8d-bd05-3a11fd32cb2b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:14:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ac9d897c-7f9e-4e8d-bd05-3a11fd32cb2b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:14:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-ac9d897c-7f9e-4e8d-bd05-3a11fd32cb2b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:14:48 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-ac9d897c-7f9e-4e8d-bd05-3a11fd32cb2b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1332668b568e41a98bb68f6c28c92db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6241b8bab90c4f1991413b84c5241baf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 16:14:48 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-ac9d897c-7f9e-4e8d-bd05-3a11fd32cb2b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371" status: 200 len: 1545 microversion: 2.1 time: 0.340615 Apr 11 16:14:48 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 365/1095] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:14:48 2023] GET /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371 => generated 1545 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:15:48 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:15:48 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:15:48 user devstack@n-api.service[61166]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:15:48 user devstack@n-api.service[61166]: Tue Apr 11 16:15:48 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371/os-interface (ip 10.0.0.210) !!! Apr 11 16:15:48 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:15:48 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:15:48 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-9a037b78-b58f-4df0-b69a-a6ff6c6be6bf tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:15:48 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-9a037b78-b58f-4df0-b69a-a6ff6c6be6bf tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:15:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-9a037b78-b58f-4df0-b69a-a6ff6c6be6bf tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:15:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-9a037b78-b58f-4df0-b69a-a6ff6c6be6bf tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:15:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-9a037b78-b58f-4df0-b69a-a6ff6c6be6bf tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:15:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-9a037b78-b58f-4df0-b69a-a6ff6c6be6bf tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:15:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-9a037b78-b58f-4df0-b69a-a6ff6c6be6bf tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:15:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-9a037b78-b58f-4df0-b69a-a6ff6c6be6bf tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:15:49 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-9a037b78-b58f-4df0-b69a-a6ff6c6be6bf tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.184391 Apr 11 16:15:49 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 363/1096] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 16:15:48 2023] GET /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371/os-interface => generated 282 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:15:49 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:15:49 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:15:49 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:15:49 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-3ab531e5-d57f-4954-8851-dbaa789f3fd3 req-7b4db91a-5b8e-4045-9900-91fa191d045d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cce5fba0-a0e4-46c1-8388-96a979360371", "tag": "928d0128-648f-46b1-85df-d743f3b9b642"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:15:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-3ab531e5-d57f-4954-8851-dbaa789f3fd3 req-7b4db91a-5b8e-4045-9900-91fa191d045d service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:15:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-3ab531e5-d57f-4954-8851-dbaa789f3fd3 req-7b4db91a-5b8e-4045-9900-91fa191d045d service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:15:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-3ab531e5-d57f-4954-8851-dbaa789f3fd3 req-7b4db91a-5b8e-4045-9900-91fa191d045d service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:15:49 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:15:49 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-3ab531e5-d57f-4954-8851-dbaa789f3fd3 req-7b4db91a-5b8e-4045-9900-91fa191d045d service nova] Creating event network-changed:928d0128-648f-46b1-85df-d743f3b9b642 for instance cce5fba0-a0e4-46c1-8388-96a979360371 on user Apr 11 16:15:49 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:15:49 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-3ab531e5-d57f-4954-8851-dbaa789f3fd3 req-7b4db91a-5b8e-4045-9900-91fa191d045d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044811 Apr 11 16:15:49 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 369/1097] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:15:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:15:49 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-91bacf26-ee02-486c-9b64-64f1ad0324ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:15:49 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-91bacf26-ee02-486c-9b64-64f1ad0324ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:15:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-91bacf26-ee02-486c-9b64-64f1ad0324ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:15:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-91bacf26-ee02-486c-9b64-64f1ad0324ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:15:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-91bacf26-ee02-486c-9b64-64f1ad0324ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:15:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-91bacf26-ee02-486c-9b64-64f1ad0324ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:15:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-91bacf26-ee02-486c-9b64-64f1ad0324ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:15:49 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-91bacf26-ee02-486c-9b64-64f1ad0324ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:15:50 user devstack@n-api.service[61165]: INFO oslo.messaging._drivers.impl_rabbit [-] [2290b1d4-22a2-492c-8aed-024685845370] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 45288. Apr 11 16:15:50 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-91bacf26-ee02-486c-9b64-64f1ad0324ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371/ips" status: 200 len: 108 microversion: 2.1 time: 0.066929 Apr 11 16:15:50 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 366/1098] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 16:15:49 2023] GET /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371/ips => generated 108 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:15:51 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "789af7ed-0979-44c1-a717-fed1749c1b0a"}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:15:51 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:15:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:15:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:15:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:15:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:15:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:15:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:15:51 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301683 Apr 11 16:15:51 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 364/1099] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 16:15:51 2023] POST /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:15:58 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-99007e0d-7b07-4135-9e90-7bdeb6ba4d61 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "789af7ed-0979-44c1-a717-fed1749c1b0a"}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:15:58 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-99007e0d-7b07-4135-9e90-7bdeb6ba4d61 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:15:58 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-99007e0d-7b07-4135-9e90-7bdeb6ba4d61 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:15:58 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-99007e0d-7b07-4135-9e90-7bdeb6ba4d61 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:15:58 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-99007e0d-7b07-4135-9e90-7bdeb6ba4d61 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:15:58 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-99007e0d-7b07-4135-9e90-7bdeb6ba4d61 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:15:58 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-99007e0d-7b07-4135-9e90-7bdeb6ba4d61 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:15:58 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-99007e0d-7b07-4135-9e90-7bdeb6ba4d61 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:15:58 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-99007e0d-7b07-4135-9e90-7bdeb6ba4d61 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] HTTP exception thrown: Invalid volume: volume 789af7ed-0979-44c1-a717-fed1749c1b0a is already attached to instances: cce5fba0-a0e4-46c1-8388-96a979360371 Apr 11 16:15:58 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-99007e0d-7b07-4135-9e90-7bdeb6ba4d61 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Request method failure captured: Apr 11 16:15:58 user devstack@n-api.service[61167]: request: POST /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371/os-volume_attachments HTTP/1.1 Apr 11 16:15:58 user devstack@n-api.service[61167]: Accept: application/json Apr 11 16:15:58 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 16:15:58 user devstack@n-api.service[61167]: Connection: close Apr 11 16:15:58 user devstack@n-api.service[61167]: Content-Length: 74 Apr 11 16:15:58 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 16:15:58 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 16:15:58 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 16:15:58 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 16:15:58 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNYW_L9XPHcG5KwL6GJb3NujGL_MZ0JPbbniXnZG6USwza0gVSkBeTzoWC1TAhtn2kzyHJE9gQeBeHlRXcZGNlDuv-D-5XU-i-C7Lz9sn_3a9pm_8fvd7zmQfA44_cXWAvDPZK4ruikdn_0YxTNjsqLaYSEiEkpcPJuiOTrKhfHHA7-c Apr 11 16:15:58 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 16:15:58 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 16:15:58 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 16:15:58 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 16:15:58 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 16:15:58 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 16:15:58 user devstack@n-api.service[61167]: X-Project-Id: 6241b8bab90c4f1991413b84c5241baf Apr 11 16:15:58 user devstack@n-api.service[61167]: X-Project-Name: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:15:58 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 16:15:58 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 16:15:58 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 16:15:58 user devstack@n-api.service[61167]: X-Tenant: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:15:58 user devstack@n-api.service[61167]: X-Tenant-Id: 6241b8bab90c4f1991413b84c5241baf Apr 11 16:15:58 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:15:58 user devstack@n-api.service[61167]: X-User: tempest-AttachVolumeNegativeTest-537147684-project-member Apr 11 16:15:58 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 16:15:58 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 16:15:58 user devstack@n-api.service[61167]: X-User-Id: 1332668b568e41a98bb68f6c28c92db9 Apr 11 16:15:58 user devstack@n-api.service[61167]: X-User-Name: tempest-AttachVolumeNegativeTest-537147684-project-member Apr 11 16:15:58 user devstack@n-api.service[61167]: Apr 11 16:15:58 user devstack@n-api.service[61167]: {"volumeAttachment": {"volumeId": "789af7ed-0979-44c1-a717-fed1749c1b0a"}} Apr 11 16:15:58 user devstack@n-api.service[61167]: method: > Apr 11 16:15:58 user devstack@n-api.service[61167]: exception: Invalid volume: volume 789af7ed-0979-44c1-a717-fed1749c1b0a is already attached to instances: cce5fba0-a0e4-46c1-8388-96a979360371 Apr 11 16:15:58 user devstack@n-api.service[61167]: action_args: {'server_id': 'cce5fba0-a0e4-46c1-8388-96a979360371', 'body': {'volumeAttachment': {'volumeId': '789af7ed-0979-44c1-a717-fed1749c1b0a'}}} Apr 11 16:15:58 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 789af7ed-0979-44c1-a717-fed1749c1b0a is already attached to instances: cce5fba0-a0e4-46c1-8388-96a979360371 Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 789af7ed-0979-44c1-a717-fed1749c1b0a is already attached to instances: cce5fba0-a0e4-46c1-8388-96a979360371 Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 789af7ed-0979-44c1-a717-fed1749c1b0a is already attached to instances: cce5fba0-a0e4-46c1-8388-96a979360371 Apr 11 16:15:58 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 16:15:58 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-99007e0d-7b07-4135-9e90-7bdeb6ba4d61 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Returning 400 to user: Invalid volume: volume 789af7ed-0979-44c1-a717-fed1749c1b0a is already attached to instances: cce5fba0-a0e4-46c1-8388-96a979360371 {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 16:15:58 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-99007e0d-7b07-4135-9e90-7bdeb6ba4d61 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.249830 Apr 11 16:15:58 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 370/1100] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 16:15:58 2023] POST /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371/os-volume_attachments => generated 174 bytes in 253 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 16:15:58 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:15:58 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:15:58 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:15:58 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:15:58 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:15:58 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:15:58 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:15:58 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:15:58 user devstack@n-api.service[61165]: DEBUG nova.objects.instance [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lazy-loading 'services' on Instance uuid cce5fba0-a0e4-46c1-8388-96a979360371 {{(pid=61165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 16:15:58 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371/os-volume_attachments/789af7ed-0979-44c1-a717-fed1749c1b0a" status: 202 len: 0 microversion: 2.1 time: 0.161416 Apr 11 16:15:58 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 367/1101] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 16:15:58 2023] DELETE /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371/os-volume_attachments/789af7ed-0979-44c1-a717-fed1749c1b0a => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:15:58 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-33396cd6-336b-41ea-9877-fb7474ba1c21 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:15:58 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-33396cd6-336b-41ea-9877-fb7474ba1c21 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:15:58 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-33396cd6-336b-41ea-9877-fb7474ba1c21 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:15:58 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-33396cd6-336b-41ea-9877-fb7474ba1c21 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:15:58 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-33396cd6-336b-41ea-9877-fb7474ba1c21 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:15:58 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-33396cd6-336b-41ea-9877-fb7474ba1c21 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:15:58 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-33396cd6-336b-41ea-9877-fb7474ba1c21 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:15:58 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-33396cd6-336b-41ea-9877-fb7474ba1c21 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:15:58 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-33396cd6-336b-41ea-9877-fb7474ba1c21 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110968 Apr 11 16:15:58 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 365/1102] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 16:15:58 2023] GET /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 16:16:48 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-82786b03-d976-42cd-b015-795d1d89daf4 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:16:48 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-82786b03-d976-42cd-b015-795d1d89daf4 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:16:48 user devstack@n-api.service[61167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 11 16:16:48 user devstack@n-api.service[61167]: Tue Apr 11 16:16:48 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371/os-volume_attachments (ip 10.0.0.210) !!! Apr 11 16:16:48 user devstack@n-api.service[61167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 11 16:16:48 user devstack@n-api.service[61167]: Tue Apr 11 16:16:48 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371/os-volume_attachments (ip 10.0.0.210) !!! Apr 11 16:16:48 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=4 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:16:48 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=8 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:16:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-82786b03-d976-42cd-b015-795d1d89daf4 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:16:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-82786b03-d976-42cd-b015-795d1d89daf4 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:16:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-82786b03-d976-42cd-b015-795d1d89daf4 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:16:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-82786b03-d976-42cd-b015-795d1d89daf4 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:16:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-82786b03-d976-42cd-b015-795d1d89daf4 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:16:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-82786b03-d976-42cd-b015-795d1d89daf4 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:16:48 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-82786b03-d976-42cd-b015-795d1d89daf4 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052143 Apr 11 16:16:48 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 371/1103] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 16:16:48 2023] GET /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 16:16:48 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:16:48 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:16:48 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:16:48 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:16:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:16:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:16:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:16:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:16:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:16:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:16:48 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Going to try to terminate instance {{(pid=61165) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 16:16:49 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371" status: 204 len: 0 microversion: 2.1 time: 0.119174 Apr 11 16:16:49 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 368/1104] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 16:16:48 2023] DELETE /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 16:16:49 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-923b1a9b-fa7e-4fb9-820d-7b9c964f33f3 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:16:49 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-923b1a9b-fa7e-4fb9-820d-7b9c964f33f3 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:16:49 user devstack@n-api.service[61166]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:16:49 user devstack@n-api.service[61166]: Tue Apr 11 16:16:49 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371 (ip 10.0.0.210) !!! Apr 11 16:16:49 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:16:49 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:16:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-923b1a9b-fa7e-4fb9-820d-7b9c964f33f3 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:16:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-923b1a9b-fa7e-4fb9-820d-7b9c964f33f3 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:16:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-923b1a9b-fa7e-4fb9-820d-7b9c964f33f3 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:16:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-923b1a9b-fa7e-4fb9-820d-7b9c964f33f3 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:16:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-923b1a9b-fa7e-4fb9-820d-7b9c964f33f3 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:16:49 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-923b1a9b-fa7e-4fb9-820d-7b9c964f33f3 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:16:49 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-bd7207cc-4d2e-42be-b700-3f4db1240b98 req-e3cd723b-ae3a-450a-82c3-8648e04d9535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cce5fba0-a0e4-46c1-8388-96a979360371", "name": "network-vif-unplugged", "status": "completed", "tag": "928d0128-648f-46b1-85df-d743f3b9b642"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:16:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-bd7207cc-4d2e-42be-b700-3f4db1240b98 req-e3cd723b-ae3a-450a-82c3-8648e04d9535 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:16:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-bd7207cc-4d2e-42be-b700-3f4db1240b98 req-e3cd723b-ae3a-450a-82c3-8648e04d9535 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:16:49 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-bd7207cc-4d2e-42be-b700-3f4db1240b98 req-e3cd723b-ae3a-450a-82c3-8648e04d9535 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:16:49 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-923b1a9b-fa7e-4fb9-820d-7b9c964f33f3 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1332668b568e41a98bb68f6c28c92db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6241b8bab90c4f1991413b84c5241baf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 16:16:49 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-bd7207cc-4d2e-42be-b700-3f4db1240b98 req-e3cd723b-ae3a-450a-82c3-8648e04d9535 service nova] Creating event network-vif-unplugged:928d0128-648f-46b1-85df-d743f3b9b642 for instance cce5fba0-a0e4-46c1-8388-96a979360371 on user Apr 11 16:16:49 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-923b1a9b-fa7e-4fb9-820d-7b9c964f33f3 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371" status: 200 len: 1670 microversion: 2.1 time: 0.266818 Apr 11 16:16:49 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 366/1105] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:16:49 2023] GET /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371 => generated 1670 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:16:49 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-bd7207cc-4d2e-42be-b700-3f4db1240b98 req-e3cd723b-ae3a-450a-82c3-8648e04d9535 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037153 Apr 11 16:16:49 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 372/1106] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:16:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:16:50 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-45009ea6-54bc-40b2-8f92-21d7b1f7669b req-1187a413-dd8f-4b1c-804e-3b621f0b8333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cce5fba0-a0e4-46c1-8388-96a979360371", "name": "network-vif-deleted", "tag": "928d0128-648f-46b1-85df-d743f3b9b642"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:16:50 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-45009ea6-54bc-40b2-8f92-21d7b1f7669b req-1187a413-dd8f-4b1c-804e-3b621f0b8333 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:16:50 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-45009ea6-54bc-40b2-8f92-21d7b1f7669b req-1187a413-dd8f-4b1c-804e-3b621f0b8333 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:16:50 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-45009ea6-54bc-40b2-8f92-21d7b1f7669b req-1187a413-dd8f-4b1c-804e-3b621f0b8333 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:16:50 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-45009ea6-54bc-40b2-8f92-21d7b1f7669b req-1187a413-dd8f-4b1c-804e-3b621f0b8333 service nova] Creating event network-vif-deleted:928d0128-648f-46b1-85df-d743f3b9b642 for instance cce5fba0-a0e4-46c1-8388-96a979360371 on user Apr 11 16:16:50 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-45009ea6-54bc-40b2-8f92-21d7b1f7669b req-1187a413-dd8f-4b1c-804e-3b621f0b8333 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078196 Apr 11 16:16:50 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 369/1107] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:16:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:16:51 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-6a9b9af1-f22d-4ba0-a25c-4e138f9bcc33 req-c8ab8a2f-beb7-49a2-b2fd-809c0255cdec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cce5fba0-a0e4-46c1-8388-96a979360371", "name": "network-vif-plugged", "status": "completed", "tag": "928d0128-648f-46b1-85df-d743f3b9b642"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:16:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-6a9b9af1-f22d-4ba0-a25c-4e138f9bcc33 req-c8ab8a2f-beb7-49a2-b2fd-809c0255cdec service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:16:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-6a9b9af1-f22d-4ba0-a25c-4e138f9bcc33 req-c8ab8a2f-beb7-49a2-b2fd-809c0255cdec service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:16:51 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-6a9b9af1-f22d-4ba0-a25c-4e138f9bcc33 req-c8ab8a2f-beb7-49a2-b2fd-809c0255cdec service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:16:51 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-6a9b9af1-f22d-4ba0-a25c-4e138f9bcc33 req-c8ab8a2f-beb7-49a2-b2fd-809c0255cdec service nova] Creating event network-vif-plugged:928d0128-648f-46b1-85df-d743f3b9b642 for instance cce5fba0-a0e4-46c1-8388-96a979360371 on user Apr 11 16:16:51 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-6a9b9af1-f22d-4ba0-a25c-4e138f9bcc33 req-c8ab8a2f-beb7-49a2-b2fd-809c0255cdec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033869 Apr 11 16:16:51 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 367/1108] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:16:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:17:39 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=4 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:17:39 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=8 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:17:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-aab773aa-8910-4e27-8129-9ab47d87005a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:17:39 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-aab773aa-8910-4e27-8129-9ab47d87005a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:17:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-aab773aa-8910-4e27-8129-9ab47d87005a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:17:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-aab773aa-8910-4e27-8129-9ab47d87005a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:17:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-aab773aa-8910-4e27-8129-9ab47d87005a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:17:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-aab773aa-8910-4e27-8129-9ab47d87005a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:17:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-aab773aa-8910-4e27-8129-9ab47d87005a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:17:39 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-aab773aa-8910-4e27-8129-9ab47d87005a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:17:39 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-aab773aa-8910-4e27-8129-9ab47d87005a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] HTTP exception thrown: Instance cce5fba0-a0e4-46c1-8388-96a979360371 could not be found. Apr 11 16:17:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-aab773aa-8910-4e27-8129-9ab47d87005a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Request method failure captured: Apr 11 16:17:39 user devstack@n-api.service[61167]: request: GET /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371 HTTP/1.1 Apr 11 16:17:39 user devstack@n-api.service[61167]: Accept: application/json Apr 11 16:17:39 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 16:17:39 user devstack@n-api.service[61167]: Connection: close Apr 11 16:17:39 user devstack@n-api.service[61167]: Content-Length: 0 Apr 11 16:17:39 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 16:17:39 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 16:17:39 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 16:17:39 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 16:17:39 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNYW_L9XPHcG5KwL6GJb3NujGL_MZ0JPbbniXnZG6USwza0gVSkBeTzoWC1TAhtn2kzyHJE9gQeBeHlRXcZGNlDuv-D-5XU-i-C7Lz9sn_3a9pm_8fvd7zmQfA44_cXWAvDPZK4ruikdn_0YxTNjsqLaYSEiEkpcPJuiOTrKhfHHA7-c Apr 11 16:17:39 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 16:17:39 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 16:17:39 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 16:17:39 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 16:17:39 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 16:17:39 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 16:17:39 user devstack@n-api.service[61167]: X-Project-Id: 6241b8bab90c4f1991413b84c5241baf Apr 11 16:17:39 user devstack@n-api.service[61167]: X-Project-Name: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:17:39 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 16:17:39 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 16:17:39 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 16:17:39 user devstack@n-api.service[61167]: X-Tenant: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:17:39 user devstack@n-api.service[61167]: X-Tenant-Id: 6241b8bab90c4f1991413b84c5241baf Apr 11 16:17:39 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:17:39 user devstack@n-api.service[61167]: X-User: tempest-AttachVolumeNegativeTest-537147684-project-member Apr 11 16:17:39 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 16:17:39 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 16:17:39 user devstack@n-api.service[61167]: X-User-Id: 1332668b568e41a98bb68f6c28c92db9 Apr 11 16:17:39 user devstack@n-api.service[61167]: X-User-Name: tempest-AttachVolumeNegativeTest-537147684-project-member Apr 11 16:17:39 user devstack@n-api.service[61167]: method: > Apr 11 16:17:39 user devstack@n-api.service[61167]: exception: Instance cce5fba0-a0e4-46c1-8388-96a979360371 could not be found. Apr 11 16:17:39 user devstack@n-api.service[61167]: action_args: {'id': 'cce5fba0-a0e4-46c1-8388-96a979360371'} Apr 11 16:17:39 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cce5fba0-a0e4-46c1-8388-96a979360371 could not be found. Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cce5fba0-a0e4-46c1-8388-96a979360371 could not be found. Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cce5fba0-a0e4-46c1-8388-96a979360371 could not be found. Apr 11 16:17:39 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 16:17:39 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-aab773aa-8910-4e27-8129-9ab47d87005a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Returning 404 to user: Instance cce5fba0-a0e4-46c1-8388-96a979360371 could not be found. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 16:17:39 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-aab773aa-8910-4e27-8129-9ab47d87005a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371" status: 404 len: 111 microversion: 2.1 time: 0.036493 Apr 11 16:17:39 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 373/1109] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:17:39 2023] GET /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:17:39 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:17:39 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:17:39 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-56085acd-0ddf-4b80-929e-85d8513b0fa2 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '.version_select at 0x7f4c2eb3fc70>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:17:39 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-56085acd-0ddf-4b80-929e-85d8513b0fa2 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1806827597" status: 202 len: 0 microversion: 2.1 time: 0.039738 Apr 11 16:17:39 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 370/1110] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 16:17:39 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1806827597 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 11 16:17:40 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:17:40 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=8 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:17:40 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-7bb8a6a8-15fa-47a9-ac0d-e0f54112b6af tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Action: 'create', calling method: .version_select at 0x7f4c2edf4040>, body: {"keypair": {"name": "tempest-keypair-987834870", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8dlbQFiB7ISPLitc6dlEUMareriBSlnSSkyjSbknoEp8Kff9mdhoyWRUd8YJ7RHBILd2bd9WuL5uTfC2Oa/ga9zutVFhTsrhuX4vX+7GQ3xSh2wsWvbCADZDal6vyiPQ=="}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:17:40 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-7bb8a6a8-15fa-47a9-ac0d-e0f54112b6af tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Getting quotas for project 6241b8bab90c4f1991413b84c5241baf. Resources: {'key_pairs'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:17:40 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-7bb8a6a8-15fa-47a9-ac0d-e0f54112b6af tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Getting quotas for user 1332668b568e41a98bb68f6c28c92db9 and project 6241b8bab90c4f1991413b84c5241baf. Resources: {'key_pairs'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:17:40 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-7bb8a6a8-15fa-47a9-ac0d-e0f54112b6af tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.066166 Apr 11 16:17:40 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 368/1111] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 16:17:40 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:17:41 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2006453280", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "c3def4c9-33a3-48eb-ad5c-45bb499758ae"}], "security_groups": [{"name": "tempest-securitygroup--493872067"}], "key_name": "tempest-keypair-987834870", "user_data": "}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:17:41 user devstack@n-api.service[61167]: DEBUG nova.network.neutron [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] validate_networks() for [('c3def4c9-33a3-48eb-ad5c-45bb499758ae', None, None, None, None, None)] {{(pid=61167) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 16:17:42 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Flavor limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 16:17:42 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Image limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 16:17:42 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Flavor pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 16:17:42 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Image pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 16:17:42 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 16:17:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:17:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:17:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:17:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:17:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:17:42 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:17:42 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Getting quotas for project 6241b8bab90c4f1991413b84c5241baf. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:17:42 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Getting quotas for user 1332668b568e41a98bb68f6c28c92db9 and project 6241b8bab90c4f1991413b84c5241baf. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:17:42 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Going to run 1 instances... {{(pid=61167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 16:17:42 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52fe638c-5ada-47d5-b376-233bfa808a37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 16:17:42 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.661928 Apr 11 16:17:42 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 374/1112] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 16:17:41 2023] POST /compute/v2.1/servers => generated 399 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 16:17:42 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-dd42d562-efbe-47a2-836a-599fa0f4b94f tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:17:42 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-dd42d562-efbe-47a2-836a-599fa0f4b94f tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:17:42 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-dd42d562-efbe-47a2-836a-599fa0f4b94f tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1332668b568e41a98bb68f6c28c92db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6241b8bab90c4f1991413b84c5241baf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 16:17:42 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-dd42d562-efbe-47a2-836a-599fa0f4b94f tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0a9404e-69b2-4633-badb-520f3d92ded8" status: 200 len: 1235 microversion: 2.1 time: 0.073391 Apr 11 16:17:42 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 371/1113] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:17:42 2023] GET /compute/v2.1/servers/d0a9404e-69b2-4633-badb-520f3d92ded8 => generated 1235 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:17:44 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-25192cd9-0d4a-4150-be1e-1b086768e448 req-3ee3772e-0920-4604-a150-3e5473f8b088 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0a9404e-69b2-4633-badb-520f3d92ded8", "tag": "fa104891-1010-43ae-96f4-d7daa88d142c"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:17:44 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-25192cd9-0d4a-4150-be1e-1b086768e448 req-3ee3772e-0920-4604-a150-3e5473f8b088 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:17:44 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-25192cd9-0d4a-4150-be1e-1b086768e448 req-3ee3772e-0920-4604-a150-3e5473f8b088 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:17:44 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-25192cd9-0d4a-4150-be1e-1b086768e448 req-3ee3772e-0920-4604-a150-3e5473f8b088 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:17:44 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-25192cd9-0d4a-4150-be1e-1b086768e448 req-3ee3772e-0920-4604-a150-3e5473f8b088 service nova] Creating event network-changed:fa104891-1010-43ae-96f4-d7daa88d142c for instance d0a9404e-69b2-4633-badb-520f3d92ded8 on user Apr 11 16:17:44 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-25192cd9-0d4a-4150-be1e-1b086768e448 req-3ee3772e-0920-4604-a150-3e5473f8b088 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034300 Apr 11 16:17:44 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 369/1114] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:17:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:17:46 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-0aea3066-c719-46c2-bd90-8f3773152262 req-81dd8168-031a-4680-ae43-49b4d93e0dfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0a9404e-69b2-4633-badb-520f3d92ded8", "name": "network-vif-plugged", "status": "completed", "tag": "fa104891-1010-43ae-96f4-d7daa88d142c"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:17:46 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-0aea3066-c719-46c2-bd90-8f3773152262 req-81dd8168-031a-4680-ae43-49b4d93e0dfd service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:17:46 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-0aea3066-c719-46c2-bd90-8f3773152262 req-81dd8168-031a-4680-ae43-49b4d93e0dfd service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:17:46 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-0aea3066-c719-46c2-bd90-8f3773152262 req-81dd8168-031a-4680-ae43-49b4d93e0dfd service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:17:46 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-0aea3066-c719-46c2-bd90-8f3773152262 req-81dd8168-031a-4680-ae43-49b4d93e0dfd service nova] Creating event network-vif-plugged:fa104891-1010-43ae-96f4-d7daa88d142c for instance d0a9404e-69b2-4633-badb-520f3d92ded8 on user Apr 11 16:17:46 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-0aea3066-c719-46c2-bd90-8f3773152262 req-81dd8168-031a-4680-ae43-49b4d93e0dfd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141708 Apr 11 16:17:46 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 375/1115] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:17:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:17:48 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-8a4d0825-75dd-4de7-8b13-3d3fd625ead3 req-4d831357-5792-4b62-86bc-8e4cdcb06e82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0a9404e-69b2-4633-badb-520f3d92ded8", "name": "network-vif-plugged", "status": "completed", "tag": "fa104891-1010-43ae-96f4-d7daa88d142c"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:17:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-8a4d0825-75dd-4de7-8b13-3d3fd625ead3 req-4d831357-5792-4b62-86bc-8e4cdcb06e82 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:17:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-8a4d0825-75dd-4de7-8b13-3d3fd625ead3 req-4d831357-5792-4b62-86bc-8e4cdcb06e82 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:17:48 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-8a4d0825-75dd-4de7-8b13-3d3fd625ead3 req-4d831357-5792-4b62-86bc-8e4cdcb06e82 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:17:48 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-8a4d0825-75dd-4de7-8b13-3d3fd625ead3 req-4d831357-5792-4b62-86bc-8e4cdcb06e82 service nova] Creating event network-vif-plugged:fa104891-1010-43ae-96f4-d7daa88d142c for instance d0a9404e-69b2-4633-badb-520f3d92ded8 on user Apr 11 16:17:48 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-8a4d0825-75dd-4de7-8b13-3d3fd625ead3 req-4d831357-5792-4b62-86bc-8e4cdcb06e82 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029689 Apr 11 16:17:48 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 372/1116] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:17:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:18:32 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:18:32 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:18:32 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:18:32 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-70e42489-dfff-4d60-90e9-d48ae6097ad8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:18:32 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-70e42489-dfff-4d60-90e9-d48ae6097ad8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:18:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-70e42489-dfff-4d60-90e9-d48ae6097ad8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:18:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-70e42489-dfff-4d60-90e9-d48ae6097ad8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:18:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-70e42489-dfff-4d60-90e9-d48ae6097ad8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:18:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-70e42489-dfff-4d60-90e9-d48ae6097ad8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:18:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-70e42489-dfff-4d60-90e9-d48ae6097ad8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:18:32 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-70e42489-dfff-4d60-90e9-d48ae6097ad8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:18:32 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-70e42489-dfff-4d60-90e9-d48ae6097ad8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1332668b568e41a98bb68f6c28c92db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6241b8bab90c4f1991413b84c5241baf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 16:18:32 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-70e42489-dfff-4d60-90e9-d48ae6097ad8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0a9404e-69b2-4633-badb-520f3d92ded8" status: 200 len: 1545 microversion: 2.1 time: 0.271186 Apr 11 16:18:32 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 370/1117] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:18:32 2023] GET /compute/v2.1/servers/d0a9404e-69b2-4633-badb-520f3d92ded8 => generated 1545 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:19:32 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:19:32 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:19:32 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:19:32 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:19:32 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-e5ab2331-b9d4-4315-8925-2d43ddc24230 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:19:32 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-e5ab2331-b9d4-4315-8925-2d43ddc24230 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:19:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e5ab2331-b9d4-4315-8925-2d43ddc24230 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:19:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e5ab2331-b9d4-4315-8925-2d43ddc24230 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:19:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e5ab2331-b9d4-4315-8925-2d43ddc24230 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:19:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e5ab2331-b9d4-4315-8925-2d43ddc24230 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:19:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e5ab2331-b9d4-4315-8925-2d43ddc24230 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:19:32 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e5ab2331-b9d4-4315-8925-2d43ddc24230 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:19:32 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-e5ab2331-b9d4-4315-8925-2d43ddc24230 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0a9404e-69b2-4633-badb-520f3d92ded8/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.207736 Apr 11 16:19:32 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 376/1118] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 16:19:32 2023] GET /compute/v2.1/servers/d0a9404e-69b2-4633-badb-520f3d92ded8/os-interface => generated 283 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 16:19:33 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:19:33 user devstack@n-api.service[61165]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:19:33 user devstack@n-api.service[61165]: Tue Apr 11 16:19:33 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 11 16:19:33 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:19:33 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-187c9a29-851a-4918-a357-813ecbf9efcc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:19:33 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-187c9a29-851a-4918-a357-813ecbf9efcc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:19:33 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:19:33 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:19:33 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:19:33 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-187c9a29-851a-4918-a357-813ecbf9efcc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:19:33 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-187c9a29-851a-4918-a357-813ecbf9efcc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:19:33 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-187c9a29-851a-4918-a357-813ecbf9efcc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:19:33 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-187c9a29-851a-4918-a357-813ecbf9efcc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:19:33 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-187c9a29-851a-4918-a357-813ecbf9efcc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:19:33 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-187c9a29-851a-4918-a357-813ecbf9efcc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:19:33 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-187c9a29-851a-4918-a357-813ecbf9efcc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0a9404e-69b2-4633-badb-520f3d92ded8/ips" status: 200 len: 109 microversion: 2.1 time: 0.043445 Apr 11 16:19:33 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 371/1119] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 16:19:33 2023] GET /compute/v2.1/servers/d0a9404e-69b2-4633-badb-520f3d92ded8/ips => generated 109 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:19:33 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-e20d7a52-b5a7-4b5d-80a4-f63bf6c48806 req-8fee5e0a-6b34-4b59-98e0-f359d9673752 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0a9404e-69b2-4633-badb-520f3d92ded8", "tag": "fa104891-1010-43ae-96f4-d7daa88d142c"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:19:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-e20d7a52-b5a7-4b5d-80a4-f63bf6c48806 req-8fee5e0a-6b34-4b59-98e0-f359d9673752 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:19:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-e20d7a52-b5a7-4b5d-80a4-f63bf6c48806 req-8fee5e0a-6b34-4b59-98e0-f359d9673752 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:19:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-e20d7a52-b5a7-4b5d-80a4-f63bf6c48806 req-8fee5e0a-6b34-4b59-98e0-f359d9673752 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:19:33 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-e20d7a52-b5a7-4b5d-80a4-f63bf6c48806 req-8fee5e0a-6b34-4b59-98e0-f359d9673752 service nova] Creating event network-changed:fa104891-1010-43ae-96f4-d7daa88d142c for instance d0a9404e-69b2-4633-badb-520f3d92ded8 on user Apr 11 16:19:33 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-e20d7a52-b5a7-4b5d-80a4-f63bf6c48806 req-8fee5e0a-6b34-4b59-98e0-f359d9673752 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098797 Apr 11 16:19:33 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 373/1120] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:19:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:19:35 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d74ea732-6d3c-4463-934c-6bf832a1bbd2"}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:19:35 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:19:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:19:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:19:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:19:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:19:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:19:35 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:19:35 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d0a9404e-69b2-4633-badb-520f3d92ded8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276147 Apr 11 16:19:35 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 377/1121] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 16:19:35 2023] POST /compute/v2.1/servers/d0a9404e-69b2-4633-badb-520f3d92ded8/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:19:43 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:19:43 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:19:43 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:19:43 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:19:43 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:19:43 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:19:43 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:19:43 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:19:43 user devstack@n-api.service[61166]: DEBUG nova.objects.instance [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lazy-loading 'services' on Instance uuid d0a9404e-69b2-4633-badb-520f3d92ded8 {{(pid=61166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 16:19:43 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d0a9404e-69b2-4633-badb-520f3d92ded8/os-volume_attachments/d74ea732-6d3c-4463-934c-6bf832a1bbd2" status: 202 len: 0 microversion: 2.1 time: 0.342406 Apr 11 16:19:43 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 372/1122] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 16:19:43 2023] DELETE /compute/v2.1/servers/d0a9404e-69b2-4633-badb-520f3d92ded8/os-volume_attachments/d74ea732-6d3c-4463-934c-6bf832a1bbd2 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:19:43 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-fc16821d-50e8-48ef-955f-30a1dee242e0 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:19:43 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-fc16821d-50e8-48ef-955f-30a1dee242e0 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:19:43 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-fc16821d-50e8-48ef-955f-30a1dee242e0 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:19:43 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-fc16821d-50e8-48ef-955f-30a1dee242e0 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:19:43 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-fc16821d-50e8-48ef-955f-30a1dee242e0 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:19:43 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-fc16821d-50e8-48ef-955f-30a1dee242e0 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:19:43 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-fc16821d-50e8-48ef-955f-30a1dee242e0 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:19:43 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-fc16821d-50e8-48ef-955f-30a1dee242e0 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:19:43 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-fc16821d-50e8-48ef-955f-30a1dee242e0 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0a9404e-69b2-4633-badb-520f3d92ded8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045267 Apr 11 16:19:43 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 374/1123] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 16:19:43 2023] GET /compute/v2.1/servers/d0a9404e-69b2-4633-badb-520f3d92ded8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:20:33 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=4 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:20:33 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:20:33 user devstack@n-api.service[61167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:20:33 user devstack@n-api.service[61167]: Tue Apr 11 16:20:33 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d0a9404e-69b2-4633-badb-520f3d92ded8/os-volume_attachments (ip 10.0.0.210) !!! Apr 11 16:20:33 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-e02b7567-c081-4cd8-a12c-648832e22d46 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:20:33 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-e02b7567-c081-4cd8-a12c-648832e22d46 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:20:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e02b7567-c081-4cd8-a12c-648832e22d46 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:20:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e02b7567-c081-4cd8-a12c-648832e22d46 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:20:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e02b7567-c081-4cd8-a12c-648832e22d46 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:20:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e02b7567-c081-4cd8-a12c-648832e22d46 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:20:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e02b7567-c081-4cd8-a12c-648832e22d46 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:20:33 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-e02b7567-c081-4cd8-a12c-648832e22d46 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:20:33 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-e02b7567-c081-4cd8-a12c-648832e22d46 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0a9404e-69b2-4633-badb-520f3d92ded8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055841 Apr 11 16:20:33 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 378/1124] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 16:20:33 2023] GET /compute/v2.1/servers/d0a9404e-69b2-4633-badb-520f3d92ded8/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 16:20:33 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:20:33 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:20:33 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:20:33 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:20:33 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:20:33 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:20:33 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:20:33 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:20:33 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:20:33 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:20:33 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Going to try to terminate instance {{(pid=61166) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 16:20:33 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d0a9404e-69b2-4633-badb-520f3d92ded8" status: 204 len: 0 microversion: 2.1 time: 0.122455 Apr 11 16:20:33 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 373/1125] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 16:20:33 2023] DELETE /compute/v2.1/servers/d0a9404e-69b2-4633-badb-520f3d92ded8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 16:20:33 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-3fe4d836-25c6-45dc-ac96-ef00ad3b6d4e tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:20:33 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-3fe4d836-25c6-45dc-ac96-ef00ad3b6d4e tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:20:33 user devstack@n-api.service[61165]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:20:33 user devstack@n-api.service[61165]: Tue Apr 11 16:20:33 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d0a9404e-69b2-4633-badb-520f3d92ded8 (ip 10.0.0.210) !!! Apr 11 16:20:33 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:20:33 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=8 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:20:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-3fe4d836-25c6-45dc-ac96-ef00ad3b6d4e tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:20:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-3fe4d836-25c6-45dc-ac96-ef00ad3b6d4e tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:20:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-3fe4d836-25c6-45dc-ac96-ef00ad3b6d4e tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:20:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-3fe4d836-25c6-45dc-ac96-ef00ad3b6d4e tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:20:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-3fe4d836-25c6-45dc-ac96-ef00ad3b6d4e tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:20:33 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-3fe4d836-25c6-45dc-ac96-ef00ad3b6d4e tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:20:34 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-dc5b70c3-d594-41cd-a70a-c49dd5cae737 req-38a8fdc8-29ab-4675-a6ea-9a618f54ac96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0a9404e-69b2-4633-badb-520f3d92ded8", "name": "network-vif-unplugged", "status": "completed", "tag": "fa104891-1010-43ae-96f4-d7daa88d142c"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:20:34 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-dc5b70c3-d594-41cd-a70a-c49dd5cae737 req-38a8fdc8-29ab-4675-a6ea-9a618f54ac96 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:20:34 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-dc5b70c3-d594-41cd-a70a-c49dd5cae737 req-38a8fdc8-29ab-4675-a6ea-9a618f54ac96 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:20:34 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-dc5b70c3-d594-41cd-a70a-c49dd5cae737 req-38a8fdc8-29ab-4675-a6ea-9a618f54ac96 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:20:34 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-dc5b70c3-d594-41cd-a70a-c49dd5cae737 req-38a8fdc8-29ab-4675-a6ea-9a618f54ac96 service nova] Creating event network-vif-unplugged:fa104891-1010-43ae-96f4-d7daa88d142c for instance d0a9404e-69b2-4633-badb-520f3d92ded8 on user Apr 11 16:20:34 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-dc5b70c3-d594-41cd-a70a-c49dd5cae737 req-38a8fdc8-29ab-4675-a6ea-9a618f54ac96 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036047 Apr 11 16:20:34 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 379/1126] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:20:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:20:34 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-3fe4d836-25c6-45dc-ac96-ef00ad3b6d4e tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1332668b568e41a98bb68f6c28c92db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6241b8bab90c4f1991413b84c5241baf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 16:20:34 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-3fe4d836-25c6-45dc-ac96-ef00ad3b6d4e tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0a9404e-69b2-4633-badb-520f3d92ded8" status: 200 len: 1669 microversion: 2.1 time: 0.371098 Apr 11 16:20:34 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 375/1127] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:20:33 2023] GET /compute/v2.1/servers/d0a9404e-69b2-4633-badb-520f3d92ded8 => generated 1669 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:20:35 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-01acdd92-f795-49ec-a2eb-a60d215b730c req-3541f89e-6692-4a8c-9d46-0bfb3a9527ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0a9404e-69b2-4633-badb-520f3d92ded8", "name": "network-vif-deleted", "tag": "fa104891-1010-43ae-96f4-d7daa88d142c"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:20:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-01acdd92-f795-49ec-a2eb-a60d215b730c req-3541f89e-6692-4a8c-9d46-0bfb3a9527ba service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:20:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-01acdd92-f795-49ec-a2eb-a60d215b730c req-3541f89e-6692-4a8c-9d46-0bfb3a9527ba service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:20:35 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-01acdd92-f795-49ec-a2eb-a60d215b730c req-3541f89e-6692-4a8c-9d46-0bfb3a9527ba service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:20:35 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-01acdd92-f795-49ec-a2eb-a60d215b730c req-3541f89e-6692-4a8c-9d46-0bfb3a9527ba service nova] Creating event network-vif-deleted:fa104891-1010-43ae-96f4-d7daa88d142c for instance d0a9404e-69b2-4633-badb-520f3d92ded8 on user Apr 11 16:20:35 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-01acdd92-f795-49ec-a2eb-a60d215b730c req-3541f89e-6692-4a8c-9d46-0bfb3a9527ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079678 Apr 11 16:20:35 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 374/1128] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:20:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:20:36 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-972dfb43-b2fc-4117-9290-c7856b322166 req-45715f84-6fa3-4459-a97b-de488e08ac5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0a9404e-69b2-4633-badb-520f3d92ded8", "name": "network-vif-plugged", "status": "completed", "tag": "fa104891-1010-43ae-96f4-d7daa88d142c"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:20:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-972dfb43-b2fc-4117-9290-c7856b322166 req-45715f84-6fa3-4459-a97b-de488e08ac5d service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:20:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-972dfb43-b2fc-4117-9290-c7856b322166 req-45715f84-6fa3-4459-a97b-de488e08ac5d service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:20:36 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-972dfb43-b2fc-4117-9290-c7856b322166 req-45715f84-6fa3-4459-a97b-de488e08ac5d service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:20:36 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-972dfb43-b2fc-4117-9290-c7856b322166 req-45715f84-6fa3-4459-a97b-de488e08ac5d service nova] Creating event network-vif-plugged:fa104891-1010-43ae-96f4-d7daa88d142c for instance d0a9404e-69b2-4633-badb-520f3d92ded8 on user Apr 11 16:20:36 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-972dfb43-b2fc-4117-9290-c7856b322166 req-45715f84-6fa3-4459-a97b-de488e08ac5d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033546 Apr 11 16:20:36 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 380/1129] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:20:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:21:24 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-c8371ddd-14cf-4eed-af92-71818686adbe tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:21:24 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-c8371ddd-14cf-4eed-af92-71818686adbe tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:21:24 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:21:24 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:21:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c8371ddd-14cf-4eed-af92-71818686adbe tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:21:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c8371ddd-14cf-4eed-af92-71818686adbe tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:21:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c8371ddd-14cf-4eed-af92-71818686adbe tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:21:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c8371ddd-14cf-4eed-af92-71818686adbe tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:21:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c8371ddd-14cf-4eed-af92-71818686adbe tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:21:24 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c8371ddd-14cf-4eed-af92-71818686adbe tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:21:24 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-c8371ddd-14cf-4eed-af92-71818686adbe tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] HTTP exception thrown: Instance d0a9404e-69b2-4633-badb-520f3d92ded8 could not be found. Apr 11 16:21:24 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-c8371ddd-14cf-4eed-af92-71818686adbe tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Request method failure captured: Apr 11 16:21:24 user devstack@n-api.service[61165]: request: GET /compute/v2.1/servers/d0a9404e-69b2-4633-badb-520f3d92ded8 HTTP/1.1 Apr 11 16:21:24 user devstack@n-api.service[61165]: Accept: application/json Apr 11 16:21:24 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 16:21:24 user devstack@n-api.service[61165]: Connection: close Apr 11 16:21:24 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 16:21:24 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 16:21:24 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 16:21:24 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 16:21:24 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 16:21:24 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNYW_L9XPHcG5KwL6GJb3NujGL_MZ0JPbbniXnZG6USwza0gVSkBeTzoWC1TAhtn2kzyHJE9gQeBeHlRXcZGNlDuv-D-5XU-i-C7Lz9sn_3a9pm_8fvd7zmQfA44_cXWAvDPZK4ruikdn_0YxTNjsqLaYSEiEkpcPJuiOTrKhfHHA7-c Apr 11 16:21:24 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 16:21:24 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 16:21:24 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 16:21:24 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 16:21:24 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 16:21:24 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 16:21:24 user devstack@n-api.service[61165]: X-Project-Id: 6241b8bab90c4f1991413b84c5241baf Apr 11 16:21:24 user devstack@n-api.service[61165]: X-Project-Name: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:21:24 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 16:21:24 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 16:21:24 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 16:21:24 user devstack@n-api.service[61165]: X-Tenant: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:21:24 user devstack@n-api.service[61165]: X-Tenant-Id: 6241b8bab90c4f1991413b84c5241baf Apr 11 16:21:24 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:21:24 user devstack@n-api.service[61165]: X-User: tempest-AttachVolumeNegativeTest-537147684-project-member Apr 11 16:21:24 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 16:21:24 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 16:21:24 user devstack@n-api.service[61165]: X-User-Id: 1332668b568e41a98bb68f6c28c92db9 Apr 11 16:21:24 user devstack@n-api.service[61165]: X-User-Name: tempest-AttachVolumeNegativeTest-537147684-project-member Apr 11 16:21:24 user devstack@n-api.service[61165]: method: > Apr 11 16:21:24 user devstack@n-api.service[61165]: exception: Instance d0a9404e-69b2-4633-badb-520f3d92ded8 could not be found. Apr 11 16:21:24 user devstack@n-api.service[61165]: action_args: {'id': 'd0a9404e-69b2-4633-badb-520f3d92ded8'} Apr 11 16:21:24 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0a9404e-69b2-4633-badb-520f3d92ded8 could not be found. Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0a9404e-69b2-4633-badb-520f3d92ded8 could not be found. Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0a9404e-69b2-4633-badb-520f3d92ded8 could not be found. Apr 11 16:21:24 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:21:24 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-c8371ddd-14cf-4eed-af92-71818686adbe tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Returning 404 to user: Instance d0a9404e-69b2-4633-badb-520f3d92ded8 could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 16:21:24 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-c8371ddd-14cf-4eed-af92-71818686adbe tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0a9404e-69b2-4633-badb-520f3d92ded8" status: 404 len: 111 microversion: 2.1 time: 0.034945 Apr 11 16:21:24 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 376/1130] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:21:24 2023] GET /compute/v2.1/servers/d0a9404e-69b2-4633-badb-520f3d92ded8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:21:24 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-6a44832a-d61a-4eed-9196-7b47a3216a05 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '.version_select at 0x7f4c2ecc37f0>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:21:24 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:21:24 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:21:24 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-6a44832a-d61a-4eed-9196-7b47a3216a05 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-987834870" status: 202 len: 0 microversion: 2.1 time: 0.030333 Apr 11 16:21:24 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 375/1131] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 16:21:24 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-987834870 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:21:26 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:21:26 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=10 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:21:26 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-f5b827d3-9328-4761-974a-6e2711c5f248 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:21:26 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-f5b827d3-9328-4761-974a-6e2711c5f248 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:21:26 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f5b827d3-9328-4761-974a-6e2711c5f248 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:21:26 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f5b827d3-9328-4761-974a-6e2711c5f248 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:21:26 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f5b827d3-9328-4761-974a-6e2711c5f248 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:21:26 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f5b827d3-9328-4761-974a-6e2711c5f248 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:21:26 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f5b827d3-9328-4761-974a-6e2711c5f248 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:21:26 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f5b827d3-9328-4761-974a-6e2711c5f248 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:21:26 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-f5b827d3-9328-4761-974a-6e2711c5f248 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] HTTP exception thrown: Instance d0a9404e-69b2-4633-badb-520f3d92ded8 could not be found. Apr 11 16:21:26 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-f5b827d3-9328-4761-974a-6e2711c5f248 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Request method failure captured: Apr 11 16:21:26 user devstack@n-api.service[61167]: request: DELETE /compute/v2.1/servers/d0a9404e-69b2-4633-badb-520f3d92ded8 HTTP/1.1 Apr 11 16:21:26 user devstack@n-api.service[61167]: Accept: application/json Apr 11 16:21:26 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 16:21:26 user devstack@n-api.service[61167]: Connection: close Apr 11 16:21:26 user devstack@n-api.service[61167]: Content-Length: 0 Apr 11 16:21:26 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 16:21:26 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 16:21:26 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 16:21:26 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 16:21:26 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNYW_L9XPHcG5KwL6GJb3NujGL_MZ0JPbbniXnZG6USwza0gVSkBeTzoWC1TAhtn2kzyHJE9gQeBeHlRXcZGNlDuv-D-5XU-i-C7Lz9sn_3a9pm_8fvd7zmQfA44_cXWAvDPZK4ruikdn_0YxTNjsqLaYSEiEkpcPJuiOTrKhfHHA7-c Apr 11 16:21:26 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 16:21:26 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 16:21:26 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 16:21:26 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 16:21:26 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 16:21:26 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 16:21:26 user devstack@n-api.service[61167]: X-Project-Id: 6241b8bab90c4f1991413b84c5241baf Apr 11 16:21:26 user devstack@n-api.service[61167]: X-Project-Name: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:21:26 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 16:21:26 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 16:21:26 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 16:21:26 user devstack@n-api.service[61167]: X-Tenant: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:21:26 user devstack@n-api.service[61167]: X-Tenant-Id: 6241b8bab90c4f1991413b84c5241baf Apr 11 16:21:26 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:21:26 user devstack@n-api.service[61167]: X-User: tempest-AttachVolumeNegativeTest-537147684-project-member Apr 11 16:21:26 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 16:21:26 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 16:21:26 user devstack@n-api.service[61167]: X-User-Id: 1332668b568e41a98bb68f6c28c92db9 Apr 11 16:21:26 user devstack@n-api.service[61167]: X-User-Name: tempest-AttachVolumeNegativeTest-537147684-project-member Apr 11 16:21:26 user devstack@n-api.service[61167]: method: > Apr 11 16:21:26 user devstack@n-api.service[61167]: exception: Instance d0a9404e-69b2-4633-badb-520f3d92ded8 could not be found. Apr 11 16:21:26 user devstack@n-api.service[61167]: action_args: {'id': 'd0a9404e-69b2-4633-badb-520f3d92ded8'} Apr 11 16:21:26 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0a9404e-69b2-4633-badb-520f3d92ded8 could not be found. Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0a9404e-69b2-4633-badb-520f3d92ded8 could not be found. Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0a9404e-69b2-4633-badb-520f3d92ded8 could not be found. Apr 11 16:21:26 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 16:21:26 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-f5b827d3-9328-4761-974a-6e2711c5f248 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Returning 404 to user: Instance d0a9404e-69b2-4633-badb-520f3d92ded8 could not be found. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 16:21:26 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-f5b827d3-9328-4761-974a-6e2711c5f248 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d0a9404e-69b2-4633-badb-520f3d92ded8" status: 404 len: 111 microversion: 2.1 time: 0.040383 Apr 11 16:21:26 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 381/1132] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 16:21:26 2023] DELETE /compute/v2.1/servers/d0a9404e-69b2-4633-badb-520f3d92ded8 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:21:26 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-946d46ab-66ac-4937-96e8-a4433ca00b8b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:21:26 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-946d46ab-66ac-4937-96e8-a4433ca00b8b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:21:26 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-946d46ab-66ac-4937-96e8-a4433ca00b8b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:21:26 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-946d46ab-66ac-4937-96e8-a4433ca00b8b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:21:26 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-946d46ab-66ac-4937-96e8-a4433ca00b8b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:21:26 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-946d46ab-66ac-4937-96e8-a4433ca00b8b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:21:26 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-946d46ab-66ac-4937-96e8-a4433ca00b8b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:21:26 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-946d46ab-66ac-4937-96e8-a4433ca00b8b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:21:26 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-946d46ab-66ac-4937-96e8-a4433ca00b8b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] HTTP exception thrown: Instance d0a9404e-69b2-4633-badb-520f3d92ded8 could not be found. Apr 11 16:21:26 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-946d46ab-66ac-4937-96e8-a4433ca00b8b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Request method failure captured: Apr 11 16:21:26 user devstack@n-api.service[61165]: request: GET /compute/v2.1/servers/d0a9404e-69b2-4633-badb-520f3d92ded8 HTTP/1.1 Apr 11 16:21:26 user devstack@n-api.service[61165]: Accept: application/json Apr 11 16:21:26 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 16:21:26 user devstack@n-api.service[61165]: Connection: close Apr 11 16:21:26 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 16:21:26 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 16:21:26 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 16:21:26 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 16:21:26 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 16:21:26 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNYW_L9XPHcG5KwL6GJb3NujGL_MZ0JPbbniXnZG6USwza0gVSkBeTzoWC1TAhtn2kzyHJE9gQeBeHlRXcZGNlDuv-D-5XU-i-C7Lz9sn_3a9pm_8fvd7zmQfA44_cXWAvDPZK4ruikdn_0YxTNjsqLaYSEiEkpcPJuiOTrKhfHHA7-c Apr 11 16:21:26 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 16:21:26 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 16:21:26 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 16:21:26 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 16:21:26 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 16:21:26 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 16:21:26 user devstack@n-api.service[61165]: X-Project-Id: 6241b8bab90c4f1991413b84c5241baf Apr 11 16:21:26 user devstack@n-api.service[61165]: X-Project-Name: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:21:26 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 16:21:26 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 16:21:26 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 16:21:26 user devstack@n-api.service[61165]: X-Tenant: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:21:26 user devstack@n-api.service[61165]: X-Tenant-Id: 6241b8bab90c4f1991413b84c5241baf Apr 11 16:21:26 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:21:26 user devstack@n-api.service[61165]: X-User: tempest-AttachVolumeNegativeTest-537147684-project-member Apr 11 16:21:26 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 16:21:26 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 16:21:26 user devstack@n-api.service[61165]: X-User-Id: 1332668b568e41a98bb68f6c28c92db9 Apr 11 16:21:26 user devstack@n-api.service[61165]: X-User-Name: tempest-AttachVolumeNegativeTest-537147684-project-member Apr 11 16:21:26 user devstack@n-api.service[61165]: method: > Apr 11 16:21:26 user devstack@n-api.service[61165]: exception: Instance d0a9404e-69b2-4633-badb-520f3d92ded8 could not be found. Apr 11 16:21:26 user devstack@n-api.service[61165]: action_args: {'id': 'd0a9404e-69b2-4633-badb-520f3d92ded8'} Apr 11 16:21:26 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0a9404e-69b2-4633-badb-520f3d92ded8 could not be found. Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0a9404e-69b2-4633-badb-520f3d92ded8 could not be found. Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0a9404e-69b2-4633-badb-520f3d92ded8 could not be found. Apr 11 16:21:26 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:21:26 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-946d46ab-66ac-4937-96e8-a4433ca00b8b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Returning 404 to user: Instance d0a9404e-69b2-4633-badb-520f3d92ded8 could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 16:21:26 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-946d46ab-66ac-4937-96e8-a4433ca00b8b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0a9404e-69b2-4633-badb-520f3d92ded8" status: 404 len: 111 microversion: 2.1 time: 0.028281 Apr 11 16:21:26 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 377/1133] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:21:26 2023] GET /compute/v2.1/servers/d0a9404e-69b2-4633-badb-520f3d92ded8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:21:27 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-d419b5a1-7f98-4a02-8772-59b2cac490c8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:21:27 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-d419b5a1-7f98-4a02-8772-59b2cac490c8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:21:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d419b5a1-7f98-4a02-8772-59b2cac490c8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:21:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d419b5a1-7f98-4a02-8772-59b2cac490c8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:21:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d419b5a1-7f98-4a02-8772-59b2cac490c8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:21:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d419b5a1-7f98-4a02-8772-59b2cac490c8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:21:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d419b5a1-7f98-4a02-8772-59b2cac490c8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:21:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d419b5a1-7f98-4a02-8772-59b2cac490c8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:21:27 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-d419b5a1-7f98-4a02-8772-59b2cac490c8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] HTTP exception thrown: Instance cce5fba0-a0e4-46c1-8388-96a979360371 could not be found. Apr 11 16:21:27 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-d419b5a1-7f98-4a02-8772-59b2cac490c8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Request method failure captured: Apr 11 16:21:27 user devstack@n-api.service[61166]: request: DELETE /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371 HTTP/1.1 Apr 11 16:21:27 user devstack@n-api.service[61166]: Accept: application/json Apr 11 16:21:27 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 16:21:27 user devstack@n-api.service[61166]: Connection: close Apr 11 16:21:27 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 16:21:27 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 16:21:27 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 16:21:27 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 16:21:27 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 16:21:27 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNYW_L9XPHcG5KwL6GJb3NujGL_MZ0JPbbniXnZG6USwza0gVSkBeTzoWC1TAhtn2kzyHJE9gQeBeHlRXcZGNlDuv-D-5XU-i-C7Lz9sn_3a9pm_8fvd7zmQfA44_cXWAvDPZK4ruikdn_0YxTNjsqLaYSEiEkpcPJuiOTrKhfHHA7-c Apr 11 16:21:27 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 16:21:27 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 16:21:27 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 16:21:27 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 16:21:27 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 16:21:27 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 16:21:27 user devstack@n-api.service[61166]: X-Project-Id: 6241b8bab90c4f1991413b84c5241baf Apr 11 16:21:27 user devstack@n-api.service[61166]: X-Project-Name: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:21:27 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 16:21:27 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 16:21:27 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 16:21:27 user devstack@n-api.service[61166]: X-Tenant: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:21:27 user devstack@n-api.service[61166]: X-Tenant-Id: 6241b8bab90c4f1991413b84c5241baf Apr 11 16:21:27 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:21:27 user devstack@n-api.service[61166]: X-User: tempest-AttachVolumeNegativeTest-537147684-project-member Apr 11 16:21:27 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 16:21:27 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 16:21:27 user devstack@n-api.service[61166]: X-User-Id: 1332668b568e41a98bb68f6c28c92db9 Apr 11 16:21:27 user devstack@n-api.service[61166]: X-User-Name: tempest-AttachVolumeNegativeTest-537147684-project-member Apr 11 16:21:27 user devstack@n-api.service[61166]: method: > Apr 11 16:21:27 user devstack@n-api.service[61166]: exception: Instance cce5fba0-a0e4-46c1-8388-96a979360371 could not be found. Apr 11 16:21:27 user devstack@n-api.service[61166]: action_args: {'id': 'cce5fba0-a0e4-46c1-8388-96a979360371'} Apr 11 16:21:27 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cce5fba0-a0e4-46c1-8388-96a979360371 could not be found. Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cce5fba0-a0e4-46c1-8388-96a979360371 could not be found. Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cce5fba0-a0e4-46c1-8388-96a979360371 could not be found. Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:21:27 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-d419b5a1-7f98-4a02-8772-59b2cac490c8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Returning 404 to user: Instance cce5fba0-a0e4-46c1-8388-96a979360371 could not be found. {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 16:21:27 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-d419b5a1-7f98-4a02-8772-59b2cac490c8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371" status: 404 len: 111 microversion: 2.1 time: 0.040927 Apr 11 16:21:27 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 376/1134] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 16:21:27 2023] DELETE /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:21:27 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-75542117-cb30-4679-8f85-75b895ae7009 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:21:27 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-75542117-cb30-4679-8f85-75b895ae7009 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:21:27 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-75542117-cb30-4679-8f85-75b895ae7009 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:21:27 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-75542117-cb30-4679-8f85-75b895ae7009 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:21:27 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-75542117-cb30-4679-8f85-75b895ae7009 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:21:27 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-75542117-cb30-4679-8f85-75b895ae7009 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:21:27 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-75542117-cb30-4679-8f85-75b895ae7009 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:21:27 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-75542117-cb30-4679-8f85-75b895ae7009 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:21:27 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-75542117-cb30-4679-8f85-75b895ae7009 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] HTTP exception thrown: Instance cce5fba0-a0e4-46c1-8388-96a979360371 could not be found. Apr 11 16:21:27 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-75542117-cb30-4679-8f85-75b895ae7009 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Request method failure captured: Apr 11 16:21:27 user devstack@n-api.service[61167]: request: GET /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371 HTTP/1.1 Apr 11 16:21:27 user devstack@n-api.service[61167]: Accept: application/json Apr 11 16:21:27 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 16:21:27 user devstack@n-api.service[61167]: Connection: close Apr 11 16:21:27 user devstack@n-api.service[61167]: Content-Length: 0 Apr 11 16:21:27 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 16:21:27 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 16:21:27 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 16:21:27 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 16:21:27 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNYW_L9XPHcG5KwL6GJb3NujGL_MZ0JPbbniXnZG6USwza0gVSkBeTzoWC1TAhtn2kzyHJE9gQeBeHlRXcZGNlDuv-D-5XU-i-C7Lz9sn_3a9pm_8fvd7zmQfA44_cXWAvDPZK4ruikdn_0YxTNjsqLaYSEiEkpcPJuiOTrKhfHHA7-c Apr 11 16:21:27 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 16:21:27 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 16:21:27 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 16:21:27 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 16:21:27 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 16:21:27 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 16:21:27 user devstack@n-api.service[61167]: X-Project-Id: 6241b8bab90c4f1991413b84c5241baf Apr 11 16:21:27 user devstack@n-api.service[61167]: X-Project-Name: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:21:27 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 16:21:27 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 16:21:27 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 16:21:27 user devstack@n-api.service[61167]: X-Tenant: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:21:27 user devstack@n-api.service[61167]: X-Tenant-Id: 6241b8bab90c4f1991413b84c5241baf Apr 11 16:21:27 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:21:27 user devstack@n-api.service[61167]: X-User: tempest-AttachVolumeNegativeTest-537147684-project-member Apr 11 16:21:27 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 16:21:27 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 16:21:27 user devstack@n-api.service[61167]: X-User-Id: 1332668b568e41a98bb68f6c28c92db9 Apr 11 16:21:27 user devstack@n-api.service[61167]: X-User-Name: tempest-AttachVolumeNegativeTest-537147684-project-member Apr 11 16:21:27 user devstack@n-api.service[61167]: method: > Apr 11 16:21:27 user devstack@n-api.service[61167]: exception: Instance cce5fba0-a0e4-46c1-8388-96a979360371 could not be found. Apr 11 16:21:27 user devstack@n-api.service[61167]: action_args: {'id': 'cce5fba0-a0e4-46c1-8388-96a979360371'} Apr 11 16:21:27 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cce5fba0-a0e4-46c1-8388-96a979360371 could not be found. Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cce5fba0-a0e4-46c1-8388-96a979360371 could not be found. Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cce5fba0-a0e4-46c1-8388-96a979360371 could not be found. Apr 11 16:21:27 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 16:21:27 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-75542117-cb30-4679-8f85-75b895ae7009 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Returning 404 to user: Instance cce5fba0-a0e4-46c1-8388-96a979360371 could not be found. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 16:21:27 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-75542117-cb30-4679-8f85-75b895ae7009 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371" status: 404 len: 111 microversion: 2.1 time: 0.029390 Apr 11 16:21:27 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 382/1135] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:21:27 2023] GET /compute/v2.1/servers/cce5fba0-a0e4-46c1-8388-96a979360371 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:21:27 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-38b161ec-7905-4a10-b9b3-208eac5087f1 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:21:27 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-38b161ec-7905-4a10-b9b3-208eac5087f1 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:21:27 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-38b161ec-7905-4a10-b9b3-208eac5087f1 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:21:27 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-38b161ec-7905-4a10-b9b3-208eac5087f1 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:21:27 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-38b161ec-7905-4a10-b9b3-208eac5087f1 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:21:27 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-38b161ec-7905-4a10-b9b3-208eac5087f1 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:21:27 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-38b161ec-7905-4a10-b9b3-208eac5087f1 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:21:27 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-38b161ec-7905-4a10-b9b3-208eac5087f1 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:21:27 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-38b161ec-7905-4a10-b9b3-208eac5087f1 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] HTTP exception thrown: Instance d6e7aedb-2302-467e-83ea-07584c5b86ff could not be found. Apr 11 16:21:27 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-38b161ec-7905-4a10-b9b3-208eac5087f1 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Request method failure captured: Apr 11 16:21:27 user devstack@n-api.service[61165]: request: DELETE /compute/v2.1/servers/d6e7aedb-2302-467e-83ea-07584c5b86ff HTTP/1.1 Apr 11 16:21:27 user devstack@n-api.service[61165]: Accept: application/json Apr 11 16:21:27 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 16:21:27 user devstack@n-api.service[61165]: Connection: close Apr 11 16:21:27 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 16:21:27 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 16:21:27 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 16:21:27 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 16:21:27 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 16:21:27 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNYW_L9XPHcG5KwL6GJb3NujGL_MZ0JPbbniXnZG6USwza0gVSkBeTzoWC1TAhtn2kzyHJE9gQeBeHlRXcZGNlDuv-D-5XU-i-C7Lz9sn_3a9pm_8fvd7zmQfA44_cXWAvDPZK4ruikdn_0YxTNjsqLaYSEiEkpcPJuiOTrKhfHHA7-c Apr 11 16:21:27 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 16:21:27 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 16:21:27 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 16:21:27 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 16:21:27 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 16:21:27 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 16:21:27 user devstack@n-api.service[61165]: X-Project-Id: 6241b8bab90c4f1991413b84c5241baf Apr 11 16:21:27 user devstack@n-api.service[61165]: X-Project-Name: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:21:27 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 16:21:27 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 16:21:27 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 16:21:27 user devstack@n-api.service[61165]: X-Tenant: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:21:27 user devstack@n-api.service[61165]: X-Tenant-Id: 6241b8bab90c4f1991413b84c5241baf Apr 11 16:21:27 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:21:27 user devstack@n-api.service[61165]: X-User: tempest-AttachVolumeNegativeTest-537147684-project-member Apr 11 16:21:27 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 16:21:27 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 16:21:27 user devstack@n-api.service[61165]: X-User-Id: 1332668b568e41a98bb68f6c28c92db9 Apr 11 16:21:27 user devstack@n-api.service[61165]: X-User-Name: tempest-AttachVolumeNegativeTest-537147684-project-member Apr 11 16:21:27 user devstack@n-api.service[61165]: method: > Apr 11 16:21:27 user devstack@n-api.service[61165]: exception: Instance d6e7aedb-2302-467e-83ea-07584c5b86ff could not be found. Apr 11 16:21:27 user devstack@n-api.service[61165]: action_args: {'id': 'd6e7aedb-2302-467e-83ea-07584c5b86ff'} Apr 11 16:21:27 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6e7aedb-2302-467e-83ea-07584c5b86ff could not be found. Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6e7aedb-2302-467e-83ea-07584c5b86ff could not be found. Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6e7aedb-2302-467e-83ea-07584c5b86ff could not be found. Apr 11 16:21:27 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:21:27 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-38b161ec-7905-4a10-b9b3-208eac5087f1 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Returning 404 to user: Instance d6e7aedb-2302-467e-83ea-07584c5b86ff could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 16:21:27 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-38b161ec-7905-4a10-b9b3-208eac5087f1 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d6e7aedb-2302-467e-83ea-07584c5b86ff" status: 404 len: 111 microversion: 2.1 time: 0.032284 Apr 11 16:21:27 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 378/1136] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 16:21:27 2023] DELETE /compute/v2.1/servers/d6e7aedb-2302-467e-83ea-07584c5b86ff => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:21:27 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-d5873bfe-04e5-43e6-b639-781ef2ba9b60 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:21:27 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-d5873bfe-04e5-43e6-b639-781ef2ba9b60 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:21:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d5873bfe-04e5-43e6-b639-781ef2ba9b60 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:21:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d5873bfe-04e5-43e6-b639-781ef2ba9b60 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:21:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d5873bfe-04e5-43e6-b639-781ef2ba9b60 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:21:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d5873bfe-04e5-43e6-b639-781ef2ba9b60 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:21:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d5873bfe-04e5-43e6-b639-781ef2ba9b60 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:21:27 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-d5873bfe-04e5-43e6-b639-781ef2ba9b60 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:21:27 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-d5873bfe-04e5-43e6-b639-781ef2ba9b60 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] HTTP exception thrown: Instance d6e7aedb-2302-467e-83ea-07584c5b86ff could not be found. Apr 11 16:21:27 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-d5873bfe-04e5-43e6-b639-781ef2ba9b60 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Request method failure captured: Apr 11 16:21:27 user devstack@n-api.service[61166]: request: GET /compute/v2.1/servers/d6e7aedb-2302-467e-83ea-07584c5b86ff HTTP/1.1 Apr 11 16:21:27 user devstack@n-api.service[61166]: Accept: application/json Apr 11 16:21:27 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 16:21:27 user devstack@n-api.service[61166]: Connection: close Apr 11 16:21:27 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 16:21:27 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 16:21:27 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 16:21:27 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 16:21:27 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 16:21:27 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNYW_L9XPHcG5KwL6GJb3NujGL_MZ0JPbbniXnZG6USwza0gVSkBeTzoWC1TAhtn2kzyHJE9gQeBeHlRXcZGNlDuv-D-5XU-i-C7Lz9sn_3a9pm_8fvd7zmQfA44_cXWAvDPZK4ruikdn_0YxTNjsqLaYSEiEkpcPJuiOTrKhfHHA7-c Apr 11 16:21:27 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 16:21:27 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 16:21:27 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 16:21:27 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 16:21:27 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 16:21:27 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 16:21:27 user devstack@n-api.service[61166]: X-Project-Id: 6241b8bab90c4f1991413b84c5241baf Apr 11 16:21:27 user devstack@n-api.service[61166]: X-Project-Name: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:21:27 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 16:21:27 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 16:21:27 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 16:21:27 user devstack@n-api.service[61166]: X-Tenant: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:21:27 user devstack@n-api.service[61166]: X-Tenant-Id: 6241b8bab90c4f1991413b84c5241baf Apr 11 16:21:27 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:21:27 user devstack@n-api.service[61166]: X-User: tempest-AttachVolumeNegativeTest-537147684-project-member Apr 11 16:21:27 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 16:21:27 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 16:21:27 user devstack@n-api.service[61166]: X-User-Id: 1332668b568e41a98bb68f6c28c92db9 Apr 11 16:21:27 user devstack@n-api.service[61166]: X-User-Name: tempest-AttachVolumeNegativeTest-537147684-project-member Apr 11 16:21:27 user devstack@n-api.service[61166]: method: > Apr 11 16:21:27 user devstack@n-api.service[61166]: exception: Instance d6e7aedb-2302-467e-83ea-07584c5b86ff could not be found. Apr 11 16:21:27 user devstack@n-api.service[61166]: action_args: {'id': 'd6e7aedb-2302-467e-83ea-07584c5b86ff'} Apr 11 16:21:27 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6e7aedb-2302-467e-83ea-07584c5b86ff could not be found. Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6e7aedb-2302-467e-83ea-07584c5b86ff could not be found. Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6e7aedb-2302-467e-83ea-07584c5b86ff could not be found. Apr 11 16:21:27 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:21:27 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-d5873bfe-04e5-43e6-b639-781ef2ba9b60 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Returning 404 to user: Instance d6e7aedb-2302-467e-83ea-07584c5b86ff could not be found. {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 16:21:27 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-d5873bfe-04e5-43e6-b639-781ef2ba9b60 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6e7aedb-2302-467e-83ea-07584c5b86ff" status: 404 len: 111 microversion: 2.1 time: 0.029746 Apr 11 16:21:27 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 377/1137] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:21:27 2023] GET /compute/v2.1/servers/d6e7aedb-2302-467e-83ea-07584c5b86ff => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:21:28 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-ac83ed36-85d5-481b-a220-3fdfb1d92166 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:21:28 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-ac83ed36-85d5-481b-a220-3fdfb1d92166 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:21:28 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ac83ed36-85d5-481b-a220-3fdfb1d92166 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:21:28 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ac83ed36-85d5-481b-a220-3fdfb1d92166 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:21:28 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ac83ed36-85d5-481b-a220-3fdfb1d92166 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:21:28 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ac83ed36-85d5-481b-a220-3fdfb1d92166 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:21:28 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ac83ed36-85d5-481b-a220-3fdfb1d92166 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:21:28 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-ac83ed36-85d5-481b-a220-3fdfb1d92166 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:21:28 user devstack@n-api.service[61167]: INFO nova.api.openstack.wsgi [None req-ac83ed36-85d5-481b-a220-3fdfb1d92166 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] HTTP exception thrown: Instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 could not be found. Apr 11 16:21:28 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-ac83ed36-85d5-481b-a220-3fdfb1d92166 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Request method failure captured: Apr 11 16:21:28 user devstack@n-api.service[61167]: request: DELETE /compute/v2.1/servers/9f0473cd-bfe6-4b1c-83d0-6ede26811743 HTTP/1.1 Apr 11 16:21:28 user devstack@n-api.service[61167]: Accept: application/json Apr 11 16:21:28 user devstack@n-api.service[61167]: Accept-Encoding: identity Apr 11 16:21:28 user devstack@n-api.service[61167]: Connection: close Apr 11 16:21:28 user devstack@n-api.service[61167]: Content-Length: 0 Apr 11 16:21:28 user devstack@n-api.service[61167]: Content-Type: application/json Apr 11 16:21:28 user devstack@n-api.service[61167]: Host: 10.0.0.210 Apr 11 16:21:28 user devstack@n-api.service[61167]: Openstack-System-Scope: None Apr 11 16:21:28 user devstack@n-api.service[61167]: User-Agent: python-urllib3/1.26.15 Apr 11 16:21:28 user devstack@n-api.service[61167]: X-Auth-Token: gAAAAABkNYW_L9XPHcG5KwL6GJb3NujGL_MZ0JPbbniXnZG6USwza0gVSkBeTzoWC1TAhtn2kzyHJE9gQeBeHlRXcZGNlDuv-D-5XU-i-C7Lz9sn_3a9pm_8fvd7zmQfA44_cXWAvDPZK4ruikdn_0YxTNjsqLaYSEiEkpcPJuiOTrKhfHHA7-c Apr 11 16:21:28 user devstack@n-api.service[61167]: X-Domain-Id: None Apr 11 16:21:28 user devstack@n-api.service[61167]: X-Domain-Name: None Apr 11 16:21:28 user devstack@n-api.service[61167]: X-Identity-Status: Confirmed Apr 11 16:21:28 user devstack@n-api.service[61167]: X-Is-Admin-Project: True Apr 11 16:21:28 user devstack@n-api.service[61167]: X-Project-Domain-Id: default Apr 11 16:21:28 user devstack@n-api.service[61167]: X-Project-Domain-Name: Default Apr 11 16:21:28 user devstack@n-api.service[61167]: X-Project-Id: 6241b8bab90c4f1991413b84c5241baf Apr 11 16:21:28 user devstack@n-api.service[61167]: X-Project-Name: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:21:28 user devstack@n-api.service[61167]: X-Role: reader,member Apr 11 16:21:28 user devstack@n-api.service[61167]: X-Roles: reader,member Apr 11 16:21:28 user devstack@n-api.service[61167]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 16:21:28 user devstack@n-api.service[61167]: X-Tenant: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:21:28 user devstack@n-api.service[61167]: X-Tenant-Id: 6241b8bab90c4f1991413b84c5241baf Apr 11 16:21:28 user devstack@n-api.service[61167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:21:28 user devstack@n-api.service[61167]: X-User: tempest-AttachVolumeNegativeTest-537147684-project-member Apr 11 16:21:28 user devstack@n-api.service[61167]: X-User-Domain-Id: default Apr 11 16:21:28 user devstack@n-api.service[61167]: X-User-Domain-Name: Default Apr 11 16:21:28 user devstack@n-api.service[61167]: X-User-Id: 1332668b568e41a98bb68f6c28c92db9 Apr 11 16:21:28 user devstack@n-api.service[61167]: X-User-Name: tempest-AttachVolumeNegativeTest-537147684-project-member Apr 11 16:21:28 user devstack@n-api.service[61167]: method: > Apr 11 16:21:28 user devstack@n-api.service[61167]: exception: Instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 could not be found. Apr 11 16:21:28 user devstack@n-api.service[61167]: action_args: {'id': '9f0473cd-bfe6-4b1c-83d0-6ede26811743'} Apr 11 16:21:28 user devstack@n-api.service[61167]: {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 could not be found. Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 could not be found. Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 could not be found. Apr 11 16:21:28 user devstack@n-api.service[61167]: ERROR nova.api.openstack.wsgi Apr 11 16:21:28 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-ac83ed36-85d5-481b-a220-3fdfb1d92166 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Returning 404 to user: Instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 could not be found. {{(pid=61167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 16:21:28 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-ac83ed36-85d5-481b-a220-3fdfb1d92166 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9f0473cd-bfe6-4b1c-83d0-6ede26811743" status: 404 len: 111 microversion: 2.1 time: 0.030755 Apr 11 16:21:28 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 383/1138] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 16:21:28 2023] DELETE /compute/v2.1/servers/9f0473cd-bfe6-4b1c-83d0-6ede26811743 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:21:28 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-cb35b257-dcad-41a9-8f58-8308c1a704be tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:21:28 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-cb35b257-dcad-41a9-8f58-8308c1a704be tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:21:28 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cb35b257-dcad-41a9-8f58-8308c1a704be tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:21:28 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cb35b257-dcad-41a9-8f58-8308c1a704be tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:21:28 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cb35b257-dcad-41a9-8f58-8308c1a704be tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:21:28 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cb35b257-dcad-41a9-8f58-8308c1a704be tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:21:28 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cb35b257-dcad-41a9-8f58-8308c1a704be tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:21:28 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-cb35b257-dcad-41a9-8f58-8308c1a704be tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:21:28 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-cb35b257-dcad-41a9-8f58-8308c1a704be tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] HTTP exception thrown: Instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 could not be found. Apr 11 16:21:28 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-cb35b257-dcad-41a9-8f58-8308c1a704be tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Request method failure captured: Apr 11 16:21:28 user devstack@n-api.service[61165]: request: GET /compute/v2.1/servers/9f0473cd-bfe6-4b1c-83d0-6ede26811743 HTTP/1.1 Apr 11 16:21:28 user devstack@n-api.service[61165]: Accept: application/json Apr 11 16:21:28 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 16:21:28 user devstack@n-api.service[61165]: Connection: close Apr 11 16:21:28 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 16:21:28 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 16:21:28 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 16:21:28 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 16:21:28 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 16:21:28 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNYW_L9XPHcG5KwL6GJb3NujGL_MZ0JPbbniXnZG6USwza0gVSkBeTzoWC1TAhtn2kzyHJE9gQeBeHlRXcZGNlDuv-D-5XU-i-C7Lz9sn_3a9pm_8fvd7zmQfA44_cXWAvDPZK4ruikdn_0YxTNjsqLaYSEiEkpcPJuiOTrKhfHHA7-c Apr 11 16:21:28 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 16:21:28 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 16:21:28 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 16:21:28 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 16:21:28 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 16:21:28 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 16:21:28 user devstack@n-api.service[61165]: X-Project-Id: 6241b8bab90c4f1991413b84c5241baf Apr 11 16:21:28 user devstack@n-api.service[61165]: X-Project-Name: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:21:28 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 16:21:28 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 16:21:28 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6241b8bab90c4f1991413b84c5241baf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 16:21:28 user devstack@n-api.service[61165]: X-Tenant: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:21:28 user devstack@n-api.service[61165]: X-Tenant-Id: 6241b8bab90c4f1991413b84c5241baf Apr 11 16:21:28 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-537147684 Apr 11 16:21:28 user devstack@n-api.service[61165]: X-User: tempest-AttachVolumeNegativeTest-537147684-project-member Apr 11 16:21:28 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 16:21:28 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 16:21:28 user devstack@n-api.service[61165]: X-User-Id: 1332668b568e41a98bb68f6c28c92db9 Apr 11 16:21:28 user devstack@n-api.service[61165]: X-User-Name: tempest-AttachVolumeNegativeTest-537147684-project-member Apr 11 16:21:28 user devstack@n-api.service[61165]: method: > Apr 11 16:21:28 user devstack@n-api.service[61165]: exception: Instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 could not be found. Apr 11 16:21:28 user devstack@n-api.service[61165]: action_args: {'id': '9f0473cd-bfe6-4b1c-83d0-6ede26811743'} Apr 11 16:21:28 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 could not be found. Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 could not be found. Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 could not be found. Apr 11 16:21:28 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:21:28 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-cb35b257-dcad-41a9-8f58-8308c1a704be tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Returning 404 to user: Instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 16:21:28 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-cb35b257-dcad-41a9-8f58-8308c1a704be tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f0473cd-bfe6-4b1c-83d0-6ede26811743" status: 404 len: 111 microversion: 2.1 time: 0.029050 Apr 11 16:21:28 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 379/1139] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:21:28 2023] GET /compute/v2.1/servers/9f0473cd-bfe6-4b1c-83d0-6ede26811743 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:21:56 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-880122054", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "networks": [{"uuid": "52b232a4-075e-4b10-ba25-3e80eb1a06cd"}]}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:21:56 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:21:56 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:21:56 user devstack@n-api.service[61166]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:21:56 user devstack@n-api.service[61166]: Tue Apr 11 16:21:56 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 11 16:21:56 user devstack@n-api.service[61166]: DEBUG nova.network.neutron [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] validate_networks() for [('52b232a4-075e-4b10-ba25-3e80eb1a06cd', None, None, None, None, None)] {{(pid=61166) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 16:21:57 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Flavor limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 16:21:57 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Image limits 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 16:21:57 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Flavor pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 16:21:57 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Image pref 0:0:0 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 16:21:57 user devstack@n-api.service[61166]: DEBUG nova.virt.hardware [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 16:21:57 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:21:57 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:21:57 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:21:57 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:21:57 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:21:57 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:21:57 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Getting quotas for project 09bb61cdc7fa4b64baf6e8ef8b1e7815. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:21:57 user devstack@n-api.service[61166]: DEBUG nova.quota [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Getting quotas for user 341892e1cf424bc18b4b21b261659456 and project 09bb61cdc7fa4b64baf6e8ef8b1e7815. Resources: {'instances', 'cores', 'ram'} {{(pid=61166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:21:57 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Going to run 1 instances... {{(pid=61166) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 16:21:57 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52fe638c-5ada-47d5-b376-233bfa808a37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 16:21:57 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.585550 Apr 11 16:21:57 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 378/1140] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 16:21:56 2023] POST /compute/v2.1/servers => generated 378 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 16:21:57 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-a9bac116-d58f-47cb-bb09-dabab8ae58cf tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:21:57 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-a9bac116-d58f-47cb-bb09-dabab8ae58cf tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:21:57 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:21:57 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:21:57 user devstack@n-api.service[61167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:21:57 user devstack@n-api.service[61167]: Tue Apr 11 16:21:57 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/239c53cb-bad6-4da9-881f-15bbd7cc91ae (ip 10.0.0.210) !!! Apr 11 16:21:57 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-a9bac116-d58f-47cb-bb09-dabab8ae58cf tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '341892e1cf424bc18b4b21b261659456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bb61cdc7fa4b64baf6e8ef8b1e7815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 16:21:57 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-a9bac116-d58f-47cb-bb09-dabab8ae58cf tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/239c53cb-bad6-4da9-881f-15bbd7cc91ae" status: 200 len: 1212 microversion: 2.1 time: 0.105105 Apr 11 16:21:57 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 384/1141] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:21:57 2023] GET /compute/v2.1/servers/239c53cb-bad6-4da9-881f-15bbd7cc91ae => generated 1212 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:21:59 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-1fa57c67-37fc-4a99-87c3-96aef1b49c17 req-ca864f66-c41b-4534-ab88-ebbb7f0f24f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "239c53cb-bad6-4da9-881f-15bbd7cc91ae", "tag": "99328a6c-19a8-4c52-9669-c2399e6e9469"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:21:59 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=8 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:21:59 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=8 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:21:59 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-1fa57c67-37fc-4a99-87c3-96aef1b49c17 req-ca864f66-c41b-4534-ab88-ebbb7f0f24f9 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:21:59 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-1fa57c67-37fc-4a99-87c3-96aef1b49c17 req-ca864f66-c41b-4534-ab88-ebbb7f0f24f9 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:21:59 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-1fa57c67-37fc-4a99-87c3-96aef1b49c17 req-ca864f66-c41b-4534-ab88-ebbb7f0f24f9 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:21:59 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-1fa57c67-37fc-4a99-87c3-96aef1b49c17 req-ca864f66-c41b-4534-ab88-ebbb7f0f24f9 service nova] Creating event network-changed:99328a6c-19a8-4c52-9669-c2399e6e9469 for instance 239c53cb-bad6-4da9-881f-15bbd7cc91ae on user Apr 11 16:21:59 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-1fa57c67-37fc-4a99-87c3-96aef1b49c17 req-ca864f66-c41b-4534-ab88-ebbb7f0f24f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035462 Apr 11 16:21:59 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 380/1142] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:21:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:22:01 user devstack@n-api.service[61166]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c34c4012-5e24-4363-ac5f-17d8dd71dc66] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 11 16:22:01 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-1e1608de-f350-436a-ad31-c3466e484c10 req-8d146f95-1a18-485c-aeb0-57a407d55367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "239c53cb-bad6-4da9-881f-15bbd7cc91ae", "name": "network-vif-plugged", "status": "completed", "tag": "99328a6c-19a8-4c52-9669-c2399e6e9469"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:22:01 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-1e1608de-f350-436a-ad31-c3466e484c10 req-8d146f95-1a18-485c-aeb0-57a407d55367 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:22:01 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-1e1608de-f350-436a-ad31-c3466e484c10 req-8d146f95-1a18-485c-aeb0-57a407d55367 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:22:01 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-1e1608de-f350-436a-ad31-c3466e484c10 req-8d146f95-1a18-485c-aeb0-57a407d55367 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:22:01 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-1e1608de-f350-436a-ad31-c3466e484c10 req-8d146f95-1a18-485c-aeb0-57a407d55367 service nova] Creating event network-vif-plugged:99328a6c-19a8-4c52-9669-c2399e6e9469 for instance 239c53cb-bad6-4da9-881f-15bbd7cc91ae on user Apr 11 16:22:01 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-1e1608de-f350-436a-ad31-c3466e484c10 req-8d146f95-1a18-485c-aeb0-57a407d55367 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045064 Apr 11 16:22:01 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 379/1143] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:22:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:22:03 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-8346a543-6a7a-4fb0-b8da-866ba56c1321 req-75709996-f274-4845-9f78-1900c42ee532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "239c53cb-bad6-4da9-881f-15bbd7cc91ae", "name": "network-vif-plugged", "status": "completed", "tag": "99328a6c-19a8-4c52-9669-c2399e6e9469"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:22:03 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-8346a543-6a7a-4fb0-b8da-866ba56c1321 req-75709996-f274-4845-9f78-1900c42ee532 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:22:03 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-8346a543-6a7a-4fb0-b8da-866ba56c1321 req-75709996-f274-4845-9f78-1900c42ee532 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:22:03 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-8346a543-6a7a-4fb0-b8da-866ba56c1321 req-75709996-f274-4845-9f78-1900c42ee532 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:22:03 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-8346a543-6a7a-4fb0-b8da-866ba56c1321 req-75709996-f274-4845-9f78-1900c42ee532 service nova] Creating event network-vif-plugged:99328a6c-19a8-4c52-9669-c2399e6e9469 for instance 239c53cb-bad6-4da9-881f-15bbd7cc91ae on user Apr 11 16:22:03 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-8346a543-6a7a-4fb0-b8da-866ba56c1321 req-75709996-f274-4845-9f78-1900c42ee532 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044569 Apr 11 16:22:03 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 385/1144] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:22:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:22:47 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-c912a3df-d3f4-4146-b023-3718b065ed2b tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:22:47 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-c912a3df-d3f4-4146-b023-3718b065ed2b tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:22:47 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:22:47 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:22:47 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c912a3df-d3f4-4146-b023-3718b065ed2b tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:22:47 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c912a3df-d3f4-4146-b023-3718b065ed2b tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:22:47 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c912a3df-d3f4-4146-b023-3718b065ed2b tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:22:47 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c912a3df-d3f4-4146-b023-3718b065ed2b tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:22:47 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c912a3df-d3f4-4146-b023-3718b065ed2b tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:22:47 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-c912a3df-d3f4-4146-b023-3718b065ed2b tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:22:47 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-c912a3df-d3f4-4146-b023-3718b065ed2b tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '341892e1cf424bc18b4b21b261659456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bb61cdc7fa4b64baf6e8ef8b1e7815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 16:22:47 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-c912a3df-d3f4-4146-b023-3718b065ed2b tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/239c53cb-bad6-4da9-881f-15bbd7cc91ae" status: 200 len: 1495 microversion: 2.1 time: 0.170309 Apr 11 16:22:47 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 381/1145] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:22:47 2023] GET /compute/v2.1/servers/239c53cb-bad6-4da9-881f-15bbd7cc91ae => generated 1495 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:23:47 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:23:47 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell0:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:23:47 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:23:47 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:23:47 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "198df94c-d822-49f7-9f58-9265596246d5", "device": "/dev/vdb"}} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:23:47 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:23:47 user devstack@n-api.service[61166]: INFO oslo.messaging._drivers.impl_rabbit [-] [c34c4012-5e24-4363-ac5f-17d8dd71dc66] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 58516. Apr 11 16:23:47 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:23:47 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:23:47 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:23:47 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:23:47 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:23:47 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:23:48 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] 10.0.0.210 "POST /compute/v2.1/servers/239c53cb-bad6-4da9-881f-15bbd7cc91ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.455426 Apr 11 16:23:48 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 380/1146] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 16:23:47 2023] POST /compute/v2.1/servers/239c53cb-bad6-4da9-881f-15bbd7cc91ae/os-volume_attachments => generated 194 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:24:01 user devstack@n-api.service[61167]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f5e3bdb2-c95f-470f-b3a7-1902314e275b] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 11 16:24:01 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:24:01 user devstack@n-api.service[61167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:24:01 user devstack@n-api.service[61167]: Tue Apr 11 16:24:01 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/239c53cb-bad6-4da9-881f-15bbd7cc91ae/os-volume_attachments/198df94c-d822-49f7-9f58-9265596246d5 (ip 10.0.0.210) !!! Apr 11 16:24:01 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:24:01 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:24:01 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:24:01 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:24:01 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:24:01 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:24:01 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:24:01 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:24:01 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:24:01 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:24:01 user devstack@n-api.service[61167]: DEBUG nova.objects.instance [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lazy-loading 'services' on Instance uuid 239c53cb-bad6-4da9-881f-15bbd7cc91ae {{(pid=61167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 16:24:01 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/239c53cb-bad6-4da9-881f-15bbd7cc91ae/os-volume_attachments/198df94c-d822-49f7-9f58-9265596246d5" status: 202 len: 0 microversion: 2.1 time: 0.212520 Apr 11 16:24:01 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 386/1147] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 16:24:01 2023] DELETE /compute/v2.1/servers/239c53cb-bad6-4da9-881f-15bbd7cc91ae/os-volume_attachments/198df94c-d822-49f7-9f58-9265596246d5 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:24:01 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:24:01 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:24:01 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:24:01 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:24:01 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:24:01 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:24:01 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:24:01 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:24:01 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:24:01 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:24:01 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Going to try to terminate instance {{(pid=61165) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 16:24:02 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/239c53cb-bad6-4da9-881f-15bbd7cc91ae" status: 204 len: 0 microversion: 2.1 time: 0.121494 Apr 11 16:24:02 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 382/1148] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 16:24:01 2023] DELETE /compute/v2.1/servers/239c53cb-bad6-4da9-881f-15bbd7cc91ae => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 16:24:02 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-17721fdb-2e30-4e9f-b2c6-f6375a9f95f6 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:24:02 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-17721fdb-2e30-4e9f-b2c6-f6375a9f95f6 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:24:02 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:24:02 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:24:02 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-17721fdb-2e30-4e9f-b2c6-f6375a9f95f6 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:24:02 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-17721fdb-2e30-4e9f-b2c6-f6375a9f95f6 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:24:02 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-17721fdb-2e30-4e9f-b2c6-f6375a9f95f6 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:24:02 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-17721fdb-2e30-4e9f-b2c6-f6375a9f95f6 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:24:02 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-17721fdb-2e30-4e9f-b2c6-f6375a9f95f6 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:24:02 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-17721fdb-2e30-4e9f-b2c6-f6375a9f95f6 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:24:02 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-17721fdb-2e30-4e9f-b2c6-f6375a9f95f6 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '341892e1cf424bc18b4b21b261659456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bb61cdc7fa4b64baf6e8ef8b1e7815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 16:24:02 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-17721fdb-2e30-4e9f-b2c6-f6375a9f95f6 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/239c53cb-bad6-4da9-881f-15bbd7cc91ae" status: 200 len: 1547 microversion: 2.1 time: 0.172971 Apr 11 16:24:02 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 381/1149] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:24:02 2023] GET /compute/v2.1/servers/239c53cb-bad6-4da9-881f-15bbd7cc91ae => generated 1547 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:24:03 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-12bc3504-10b8-47d4-a086-43bf22171dc9 req-1b625c8f-5cb2-464a-a9ba-d5d6e2d68004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "239c53cb-bad6-4da9-881f-15bbd7cc91ae", "name": "network-vif-unplugged", "status": "completed", "tag": "99328a6c-19a8-4c52-9669-c2399e6e9469"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:24:03 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-12bc3504-10b8-47d4-a086-43bf22171dc9 req-1b625c8f-5cb2-464a-a9ba-d5d6e2d68004 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:24:03 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-12bc3504-10b8-47d4-a086-43bf22171dc9 req-1b625c8f-5cb2-464a-a9ba-d5d6e2d68004 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:24:03 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-12bc3504-10b8-47d4-a086-43bf22171dc9 req-1b625c8f-5cb2-464a-a9ba-d5d6e2d68004 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:24:03 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-12bc3504-10b8-47d4-a086-43bf22171dc9 req-1b625c8f-5cb2-464a-a9ba-d5d6e2d68004 service nova] Creating event network-vif-unplugged:99328a6c-19a8-4c52-9669-c2399e6e9469 for instance 239c53cb-bad6-4da9-881f-15bbd7cc91ae on user Apr 11 16:24:03 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-12bc3504-10b8-47d4-a086-43bf22171dc9 req-1b625c8f-5cb2-464a-a9ba-d5d6e2d68004 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031705 Apr 11 16:24:03 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 387/1150] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:24:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:24:05 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-88bf4601-7572-4fbf-b1d2-e90b33295fc8 req-199def97-48fc-4f98-87d3-567e666c46cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "239c53cb-bad6-4da9-881f-15bbd7cc91ae", "name": "network-vif-plugged", "status": "completed", "tag": "99328a6c-19a8-4c52-9669-c2399e6e9469"}, {"server_uuid": "239c53cb-bad6-4da9-881f-15bbd7cc91ae", "name": "network-vif-deleted", "tag": "99328a6c-19a8-4c52-9669-c2399e6e9469"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:24:05 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-88bf4601-7572-4fbf-b1d2-e90b33295fc8 req-199def97-48fc-4f98-87d3-567e666c46cd service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:24:05 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-88bf4601-7572-4fbf-b1d2-e90b33295fc8 req-199def97-48fc-4f98-87d3-567e666c46cd service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:24:05 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-88bf4601-7572-4fbf-b1d2-e90b33295fc8 req-199def97-48fc-4f98-87d3-567e666c46cd service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:24:05 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-88bf4601-7572-4fbf-b1d2-e90b33295fc8 req-199def97-48fc-4f98-87d3-567e666c46cd service nova] Creating event network-vif-plugged:99328a6c-19a8-4c52-9669-c2399e6e9469 for instance 239c53cb-bad6-4da9-881f-15bbd7cc91ae on user Apr 11 16:24:05 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-88bf4601-7572-4fbf-b1d2-e90b33295fc8 req-199def97-48fc-4f98-87d3-567e666c46cd service nova] Creating event network-vif-deleted:99328a6c-19a8-4c52-9669-c2399e6e9469 for instance 239c53cb-bad6-4da9-881f-15bbd7cc91ae on user Apr 11 16:24:05 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-88bf4601-7572-4fbf-b1d2-e90b33295fc8 req-199def97-48fc-4f98-87d3-567e666c46cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030882 Apr 11 16:24:05 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 383/1151] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:24:05 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:24:52 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:24:52 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:24:52 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-44a20a96-5bf9-4eb1-88ac-f305de2e25d1 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:24:52 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-44a20a96-5bf9-4eb1-88ac-f305de2e25d1 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:24:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-44a20a96-5bf9-4eb1-88ac-f305de2e25d1 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:24:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-44a20a96-5bf9-4eb1-88ac-f305de2e25d1 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:24:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-44a20a96-5bf9-4eb1-88ac-f305de2e25d1 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:24:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-44a20a96-5bf9-4eb1-88ac-f305de2e25d1 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:24:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-44a20a96-5bf9-4eb1-88ac-f305de2e25d1 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:24:52 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-44a20a96-5bf9-4eb1-88ac-f305de2e25d1 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:24:52 user devstack@n-api.service[61166]: INFO nova.api.openstack.wsgi [None req-44a20a96-5bf9-4eb1-88ac-f305de2e25d1 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] HTTP exception thrown: Instance 239c53cb-bad6-4da9-881f-15bbd7cc91ae could not be found. Apr 11 16:24:52 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-44a20a96-5bf9-4eb1-88ac-f305de2e25d1 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Request method failure captured: Apr 11 16:24:52 user devstack@n-api.service[61166]: request: GET /compute/v2.1/servers/239c53cb-bad6-4da9-881f-15bbd7cc91ae HTTP/1.1 Apr 11 16:24:52 user devstack@n-api.service[61166]: Accept: application/json Apr 11 16:24:52 user devstack@n-api.service[61166]: Accept-Encoding: identity Apr 11 16:24:52 user devstack@n-api.service[61166]: Connection: close Apr 11 16:24:52 user devstack@n-api.service[61166]: Content-Length: 0 Apr 11 16:24:52 user devstack@n-api.service[61166]: Content-Type: application/json Apr 11 16:24:52 user devstack@n-api.service[61166]: Host: 10.0.0.210 Apr 11 16:24:52 user devstack@n-api.service[61166]: Openstack-System-Scope: None Apr 11 16:24:52 user devstack@n-api.service[61166]: User-Agent: python-urllib3/1.26.15 Apr 11 16:24:52 user devstack@n-api.service[61166]: X-Auth-Token: gAAAAABkNYkh0ZCz0rumfim8r3VB-5v03BMYcUDF1slMX80Vu_Q1TJ95GRyYw9YsAkhlwUC5YoE6Giui1XZIrzBAZhIDL_UA5Wo95Q0-PtZLrr7Ih2IzRtTqqe2WhpZZter4_PEXjBSxNdyVD8MLDh-ffbgFh6PlcVb6osUcU36KBQn8iaUfDm8 Apr 11 16:24:52 user devstack@n-api.service[61166]: X-Domain-Id: None Apr 11 16:24:52 user devstack@n-api.service[61166]: X-Domain-Name: None Apr 11 16:24:52 user devstack@n-api.service[61166]: X-Identity-Status: Confirmed Apr 11 16:24:52 user devstack@n-api.service[61166]: X-Is-Admin-Project: True Apr 11 16:24:52 user devstack@n-api.service[61166]: X-Project-Domain-Id: default Apr 11 16:24:52 user devstack@n-api.service[61166]: X-Project-Domain-Name: Default Apr 11 16:24:52 user devstack@n-api.service[61166]: X-Project-Id: 09bb61cdc7fa4b64baf6e8ef8b1e7815 Apr 11 16:24:52 user devstack@n-api.service[61166]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1487607345 Apr 11 16:24:52 user devstack@n-api.service[61166]: X-Role: reader,member Apr 11 16:24:52 user devstack@n-api.service[61166]: X-Roles: reader,member Apr 11 16:24:52 user devstack@n-api.service[61166]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/09bb61cdc7fa4b64baf6e8ef8b1e7815"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/09bb61cdc7fa4b64baf6e8ef8b1e7815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/09bb61cdc7fa4b64baf6e8ef8b1e7815"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 16:24:52 user devstack@n-api.service[61166]: X-Tenant: tempest-VolumesSnapshotTestJSON-1487607345 Apr 11 16:24:52 user devstack@n-api.service[61166]: X-Tenant-Id: 09bb61cdc7fa4b64baf6e8ef8b1e7815 Apr 11 16:24:52 user devstack@n-api.service[61166]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1487607345 Apr 11 16:24:52 user devstack@n-api.service[61166]: X-User: tempest-VolumesSnapshotTestJSON-1487607345-project-member Apr 11 16:24:52 user devstack@n-api.service[61166]: X-User-Domain-Id: default Apr 11 16:24:52 user devstack@n-api.service[61166]: X-User-Domain-Name: Default Apr 11 16:24:52 user devstack@n-api.service[61166]: X-User-Id: 341892e1cf424bc18b4b21b261659456 Apr 11 16:24:52 user devstack@n-api.service[61166]: X-User-Name: tempest-VolumesSnapshotTestJSON-1487607345-project-member Apr 11 16:24:52 user devstack@n-api.service[61166]: method: > Apr 11 16:24:52 user devstack@n-api.service[61166]: exception: Instance 239c53cb-bad6-4da9-881f-15bbd7cc91ae could not be found. Apr 11 16:24:52 user devstack@n-api.service[61166]: action_args: {'id': '239c53cb-bad6-4da9-881f-15bbd7cc91ae'} Apr 11 16:24:52 user devstack@n-api.service[61166]: {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 239c53cb-bad6-4da9-881f-15bbd7cc91ae could not be found. Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 239c53cb-bad6-4da9-881f-15bbd7cc91ae could not be found. Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 239c53cb-bad6-4da9-881f-15bbd7cc91ae could not be found. Apr 11 16:24:52 user devstack@n-api.service[61166]: ERROR nova.api.openstack.wsgi Apr 11 16:24:52 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-44a20a96-5bf9-4eb1-88ac-f305de2e25d1 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Returning 404 to user: Instance 239c53cb-bad6-4da9-881f-15bbd7cc91ae could not be found. {{(pid=61166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 16:24:52 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-44a20a96-5bf9-4eb1-88ac-f305de2e25d1 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/239c53cb-bad6-4da9-881f-15bbd7cc91ae" status: 404 len: 111 microversion: 2.1 time: 0.043425 Apr 11 16:24:52 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 382/1152] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:24:52 2023] GET /compute/v2.1/servers/239c53cb-bad6-4da9-881f-15bbd7cc91ae => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:24:57 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=4 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:24:57 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:24:57 user devstack@n-api.service[61167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 11 16:24:57 user devstack@n-api.service[61167]: Tue Apr 11 16:24:57 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 11 16:24:57 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2045943056", "imageRef": "52fe638c-5ada-47d5-b376-233bfa808a37", "flavorRef": "42", "networks": [{"uuid": "52b232a4-075e-4b10-ba25-3e80eb1a06cd"}]}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:24:57 user devstack@n-api.service[61167]: INFO oslo.messaging._drivers.impl_rabbit [-] [f5e3bdb2-c95f-470f-b3a7-1902314e275b] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 39412. Apr 11 16:24:57 user devstack@n-api.service[61167]: DEBUG nova.network.neutron [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] validate_networks() for [('52b232a4-075e-4b10-ba25-3e80eb1a06cd', None, None, None, None, None)] {{(pid=61167) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 16:24:58 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Flavor limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 16:24:58 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Image limits 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 16:24:58 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Flavor pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 16:24:58 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Image pref 0:0:0 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 16:24:58 user devstack@n-api.service[61167]: DEBUG nova.virt.hardware [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 16:24:58 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:24:58 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:24:58 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:24:58 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:24:58 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:24:58 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:24:58 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Getting quotas for project 09bb61cdc7fa4b64baf6e8ef8b1e7815. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:24:58 user devstack@n-api.service[61167]: DEBUG nova.quota [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Getting quotas for user 341892e1cf424bc18b4b21b261659456 and project 09bb61cdc7fa4b64baf6e8ef8b1e7815. Resources: {'instances', 'cores', 'ram'} {{(pid=61167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:24:58 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Going to run 1 instances... {{(pid=61167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 16:24:58 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52fe638c-5ada-47d5-b376-233bfa808a37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 16:24:58 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.040349 Apr 11 16:24:58 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 388/1153] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 16:24:57 2023] POST /compute/v2.1/servers => generated 378 bytes in 1042 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 16:24:58 user devstack@n-api.service[61165]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2290b1d4-22a2-492c-8aed-024685845370] AMQP server on 10.0.0.210:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 11 16:24:58 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:24:58 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:24:58 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-459bcb93-8d46-41d8-8300-f9a3e7ca59b3 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:24:58 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-459bcb93-8d46-41d8-8300-f9a3e7ca59b3 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:24:58 user devstack@n-api.service[61165]: DEBUG nova.policy [None req-459bcb93-8d46-41d8-8300-f9a3e7ca59b3 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '341892e1cf424bc18b4b21b261659456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bb61cdc7fa4b64baf6e8ef8b1e7815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61165) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 16:24:58 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-459bcb93-8d46-41d8-8300-f9a3e7ca59b3 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae79fdab-2a0d-4dac-bcde-ac3544aca749" status: 200 len: 1213 microversion: 2.1 time: 0.078388 Apr 11 16:24:58 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 384/1154] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:24:58 2023] GET /compute/v2.1/servers/ae79fdab-2a0d-4dac-bcde-ac3544aca749 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:25:00 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-b8ec0600-0c11-4b56-b08f-e6ae2a450143 req-7c8961e3-9604-4196-8874-38f403c90524 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae79fdab-2a0d-4dac-bcde-ac3544aca749", "tag": "5304223b-a94f-43cc-b3cd-2f6f6b33ac7c"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:25:00 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-b8ec0600-0c11-4b56-b08f-e6ae2a450143 req-7c8961e3-9604-4196-8874-38f403c90524 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:25:00 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-b8ec0600-0c11-4b56-b08f-e6ae2a450143 req-7c8961e3-9604-4196-8874-38f403c90524 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:25:00 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-b8ec0600-0c11-4b56-b08f-e6ae2a450143 req-7c8961e3-9604-4196-8874-38f403c90524 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:25:00 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-b8ec0600-0c11-4b56-b08f-e6ae2a450143 req-7c8961e3-9604-4196-8874-38f403c90524 service nova] Creating event network-changed:5304223b-a94f-43cc-b3cd-2f6f6b33ac7c for instance ae79fdab-2a0d-4dac-bcde-ac3544aca749 on user Apr 11 16:25:00 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-b8ec0600-0c11-4b56-b08f-e6ae2a450143 req-7c8961e3-9604-4196-8874-38f403c90524 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034679 Apr 11 16:25:00 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 383/1155] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:25:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:25:03 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-3d45063e-fb73-4707-aff3-bb25d19664bd req-65426946-4e6e-46d9-b7bd-9685d7eed92a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae79fdab-2a0d-4dac-bcde-ac3544aca749", "name": "network-vif-plugged", "status": "completed", "tag": "5304223b-a94f-43cc-b3cd-2f6f6b33ac7c"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:25:03 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-3d45063e-fb73-4707-aff3-bb25d19664bd req-65426946-4e6e-46d9-b7bd-9685d7eed92a service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:25:03 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-3d45063e-fb73-4707-aff3-bb25d19664bd req-65426946-4e6e-46d9-b7bd-9685d7eed92a service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:25:03 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-3d45063e-fb73-4707-aff3-bb25d19664bd req-65426946-4e6e-46d9-b7bd-9685d7eed92a service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:25:03 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-3d45063e-fb73-4707-aff3-bb25d19664bd req-65426946-4e6e-46d9-b7bd-9685d7eed92a service nova] Creating event network-vif-plugged:5304223b-a94f-43cc-b3cd-2f6f6b33ac7c for instance ae79fdab-2a0d-4dac-bcde-ac3544aca749 on user Apr 11 16:25:03 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-3d45063e-fb73-4707-aff3-bb25d19664bd req-65426946-4e6e-46d9-b7bd-9685d7eed92a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102500 Apr 11 16:25:03 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 389/1156] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:25:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 16:25:05 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-f6af84af-16c5-4398-8fe6-46eea7641e1e req-74313cd5-52b5-4bf6-8c02-c95d40c282c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae79fdab-2a0d-4dac-bcde-ac3544aca749", "name": "network-vif-plugged", "status": "completed", "tag": "5304223b-a94f-43cc-b3cd-2f6f6b33ac7c"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:25:05 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-f6af84af-16c5-4398-8fe6-46eea7641e1e req-74313cd5-52b5-4bf6-8c02-c95d40c282c9 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:25:05 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-f6af84af-16c5-4398-8fe6-46eea7641e1e req-74313cd5-52b5-4bf6-8c02-c95d40c282c9 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:25:05 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-f6af84af-16c5-4398-8fe6-46eea7641e1e req-74313cd5-52b5-4bf6-8c02-c95d40c282c9 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:25:05 user devstack@n-api.service[61165]: INFO oslo.messaging._drivers.impl_rabbit [-] [2290b1d4-22a2-492c-8aed-024685845370] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 59660. Apr 11 16:25:05 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-f6af84af-16c5-4398-8fe6-46eea7641e1e req-74313cd5-52b5-4bf6-8c02-c95d40c282c9 service nova] Creating event network-vif-plugged:5304223b-a94f-43cc-b3cd-2f6f6b33ac7c for instance ae79fdab-2a0d-4dac-bcde-ac3544aca749 on user Apr 11 16:25:05 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-f6af84af-16c5-4398-8fe6-46eea7641e1e req-74313cd5-52b5-4bf6-8c02-c95d40c282c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055012 Apr 11 16:25:05 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 385/1157] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:25:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:25:48 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:25:48 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=4 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:25:48 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-22368bc3-a59a-416b-8fd1-c96b4aee763f tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:25:48 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-22368bc3-a59a-416b-8fd1-c96b4aee763f tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:25:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-22368bc3-a59a-416b-8fd1-c96b4aee763f tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:25:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-22368bc3-a59a-416b-8fd1-c96b4aee763f tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:25:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-22368bc3-a59a-416b-8fd1-c96b4aee763f tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:25:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-22368bc3-a59a-416b-8fd1-c96b4aee763f tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:25:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-22368bc3-a59a-416b-8fd1-c96b4aee763f tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:25:48 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-22368bc3-a59a-416b-8fd1-c96b4aee763f tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:25:48 user devstack@n-api.service[61166]: DEBUG nova.policy [None req-22368bc3-a59a-416b-8fd1-c96b4aee763f tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '341892e1cf424bc18b4b21b261659456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bb61cdc7fa4b64baf6e8ef8b1e7815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61166) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 16:25:48 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-22368bc3-a59a-416b-8fd1-c96b4aee763f tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae79fdab-2a0d-4dac-bcde-ac3544aca749" status: 200 len: 1495 microversion: 2.1 time: 0.239731 Apr 11 16:25:48 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 384/1158] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:25:48 2023] GET /compute/v2.1/servers/ae79fdab-2a0d-4dac-bcde-ac3544aca749 => generated 1495 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:26:48 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:26:48 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell0:SELECT=6 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:26:48 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:26:48 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=4 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:26:48 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "209c684f-2d87-48d9-8910-ccb78895b9db", "device": "/dev/vdb"}} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:26:48 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:26:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:26:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:26:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:26:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:26:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:26:48 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:26:49 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ae79fdab-2a0d-4dac-bcde-ac3544aca749/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.337901 Apr 11 16:26:49 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 390/1159] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 16:26:48 2023] POST /compute/v2.1/servers/ae79fdab-2a0d-4dac-bcde-ac3544aca749/os-volume_attachments => generated 194 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:27:01 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell0:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:27:01 user devstack@n-api.service[61165]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:27:01 user devstack@n-api.service[61165]: Tue Apr 11 16:27:01 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ae79fdab-2a0d-4dac-bcde-ac3544aca749/os-volume_attachments/209c684f-2d87-48d9-8910-ccb78895b9db (ip 10.0.0.210) !!! Apr 11 16:27:01 user devstack@n-api.service[61165]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:27:01 user devstack@n-api.service[61165]: Tue Apr 11 16:27:01 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ae79fdab-2a0d-4dac-bcde-ac3544aca749/os-volume_attachments/209c684f-2d87-48d9-8910-ccb78895b9db (ip 10.0.0.210) !!! Apr 11 16:27:01 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=6 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:27:01 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=2 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:27:01 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:27:01 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:27:01 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:27:01 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:27:01 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:27:01 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:27:01 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:27:01 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:27:01 user devstack@n-api.service[61165]: DEBUG nova.objects.instance [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lazy-loading 'services' on Instance uuid ae79fdab-2a0d-4dac-bcde-ac3544aca749 {{(pid=61165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 16:27:01 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ae79fdab-2a0d-4dac-bcde-ac3544aca749/os-volume_attachments/209c684f-2d87-48d9-8910-ccb78895b9db" status: 202 len: 0 microversion: 2.1 time: 0.261259 Apr 11 16:27:01 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 386/1160] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 16:27:01 2023] DELETE /compute/v2.1/servers/ae79fdab-2a0d-4dac-bcde-ac3544aca749/os-volume_attachments/209c684f-2d87-48d9-8910-ccb78895b9db => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:27:01 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_api:SELECT=2 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:27:01 user devstack@n-api.service[61166]: DEBUG dbcounter [-] [61166] Writing DB stats nova_cell1:SELECT=6 {{(pid=61166) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:27:01 user devstack@n-api.service[61166]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:27:01 user devstack@n-api.service[61166]: Tue Apr 11 16:27:01 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ae79fdab-2a0d-4dac-bcde-ac3544aca749 (ip 10.0.0.210) !!! Apr 11 16:27:01 user devstack@n-api.service[61166]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:27:01 user devstack@n-api.service[61166]: Tue Apr 11 16:27:01 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ae79fdab-2a0d-4dac-bcde-ac3544aca749 (ip 10.0.0.210) !!! Apr 11 16:27:01 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Calling method '>' {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:27:01 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Fetching instance by UUID {{(pid=61166) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:27:01 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:27:01 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:27:01 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:27:01 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:27:01 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:27:01 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:27:01 user devstack@n-api.service[61166]: DEBUG nova.compute.api [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Going to try to terminate instance {{(pid=61166) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 16:27:01 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ae79fdab-2a0d-4dac-bcde-ac3544aca749" status: 204 len: 0 microversion: 2.1 time: 0.141193 Apr 11 16:27:01 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 385/1161] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 16:27:01 2023] DELETE /compute/v2.1/servers/ae79fdab-2a0d-4dac-bcde-ac3544aca749 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 16:27:01 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_api:SELECT=2 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:27:01 user devstack@n-api.service[61167]: DEBUG dbcounter [-] [61167] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61167) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:27:01 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [None req-340fbbc3-320f-4286-92b3-59a3415b5ded tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Calling method '>' {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:27:01 user devstack@n-api.service[61167]: DEBUG nova.compute.api [None req-340fbbc3-320f-4286-92b3-59a3415b5ded tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Fetching instance by UUID {{(pid=61167) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:27:01 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-340fbbc3-320f-4286-92b3-59a3415b5ded tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:27:01 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-340fbbc3-320f-4286-92b3-59a3415b5ded tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:27:01 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-340fbbc3-320f-4286-92b3-59a3415b5ded tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:27:01 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-340fbbc3-320f-4286-92b3-59a3415b5ded tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:27:01 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-340fbbc3-320f-4286-92b3-59a3415b5ded tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:27:01 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [None req-340fbbc3-320f-4286-92b3-59a3415b5ded tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:27:02 user devstack@n-api.service[61167]: DEBUG nova.policy [None req-340fbbc3-320f-4286-92b3-59a3415b5ded tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '341892e1cf424bc18b4b21b261659456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bb61cdc7fa4b64baf6e8ef8b1e7815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61167) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 16:27:02 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [None req-340fbbc3-320f-4286-92b3-59a3415b5ded tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae79fdab-2a0d-4dac-bcde-ac3544aca749" status: 200 len: 1547 microversion: 2.1 time: 0.250278 Apr 11 16:27:02 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 391/1162] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:27:01 2023] GET /compute/v2.1/servers/ae79fdab-2a0d-4dac-bcde-ac3544aca749 => generated 1547 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:27:03 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [req-811c8f45-fd04-4d85-a210-a0ee2a2dc022 req-05e19117-174f-47a4-8b3e-e76a845403a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae79fdab-2a0d-4dac-bcde-ac3544aca749", "name": "network-vif-unplugged", "status": "completed", "tag": "5304223b-a94f-43cc-b3cd-2f6f6b33ac7c"}]} {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:27:03 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-811c8f45-fd04-4d85-a210-a0ee2a2dc022 req-05e19117-174f-47a4-8b3e-e76a845403a7 service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:27:03 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-811c8f45-fd04-4d85-a210-a0ee2a2dc022 req-05e19117-174f-47a4-8b3e-e76a845403a7 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:27:03 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [req-811c8f45-fd04-4d85-a210-a0ee2a2dc022 req-05e19117-174f-47a4-8b3e-e76a845403a7 service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:27:03 user devstack@n-api.service[61165]: INFO nova.api.openstack.compute.server_external_events [req-811c8f45-fd04-4d85-a210-a0ee2a2dc022 req-05e19117-174f-47a4-8b3e-e76a845403a7 service nova] Creating event network-vif-unplugged:5304223b-a94f-43cc-b3cd-2f6f6b33ac7c for instance ae79fdab-2a0d-4dac-bcde-ac3544aca749 on user Apr 11 16:27:03 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [req-811c8f45-fd04-4d85-a210-a0ee2a2dc022 req-05e19117-174f-47a4-8b3e-e76a845403a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028737 Apr 11 16:27:03 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 387/1163] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:27:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:27:04 user devstack@n-api.service[61166]: DEBUG nova.api.openstack.wsgi [req-d1489211-7779-4e5a-ad4b-e1ab732684db req-ec2b92b7-e29b-410d-9b5d-1c540e16b12b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae79fdab-2a0d-4dac-bcde-ac3544aca749", "name": "network-vif-deleted", "tag": "5304223b-a94f-43cc-b3cd-2f6f6b33ac7c"}]} {{(pid=61166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:27:04 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-d1489211-7779-4e5a-ad4b-e1ab732684db req-ec2b92b7-e29b-410d-9b5d-1c540e16b12b service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:27:04 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-d1489211-7779-4e5a-ad4b-e1ab732684db req-ec2b92b7-e29b-410d-9b5d-1c540e16b12b service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:27:04 user devstack@n-api.service[61166]: DEBUG oslo_concurrency.lockutils [req-d1489211-7779-4e5a-ad4b-e1ab732684db req-ec2b92b7-e29b-410d-9b5d-1c540e16b12b service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61166) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:27:04 user devstack@n-api.service[61166]: INFO nova.api.openstack.compute.server_external_events [req-d1489211-7779-4e5a-ad4b-e1ab732684db req-ec2b92b7-e29b-410d-9b5d-1c540e16b12b service nova] Creating event network-vif-deleted:5304223b-a94f-43cc-b3cd-2f6f6b33ac7c for instance ae79fdab-2a0d-4dac-bcde-ac3544aca749 on user Apr 11 16:27:04 user devstack@n-api.service[61166]: INFO nova.api.openstack.requestlog [req-d1489211-7779-4e5a-ad4b-e1ab732684db req-ec2b92b7-e29b-410d-9b5d-1c540e16b12b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101739 Apr 11 16:27:04 user devstack@n-api.service[61166]: [pid: 61166|app: 0|req: 386/1164] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:27:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:27:05 user devstack@n-api.service[61167]: DEBUG nova.api.openstack.wsgi [req-d088a90f-b759-4100-bc88-6ca91f0350d8 req-9131a037-1d7c-400f-88a3-4201d4ce715b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae79fdab-2a0d-4dac-bcde-ac3544aca749", "name": "network-vif-plugged", "status": "completed", "tag": "5304223b-a94f-43cc-b3cd-2f6f6b33ac7c"}]} {{(pid=61167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:27:05 user devstack@n-api.service[61167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 11 16:27:05 user devstack@n-api.service[61167]: Tue Apr 11 16:27:05 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 11 16:27:05 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-d088a90f-b759-4100-bc88-6ca91f0350d8 req-9131a037-1d7c-400f-88a3-4201d4ce715b service nova] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:27:05 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-d088a90f-b759-4100-bc88-6ca91f0350d8 req-9131a037-1d7c-400f-88a3-4201d4ce715b service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:27:05 user devstack@n-api.service[61167]: DEBUG oslo_concurrency.lockutils [req-d088a90f-b759-4100-bc88-6ca91f0350d8 req-9131a037-1d7c-400f-88a3-4201d4ce715b service nova] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61167) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:27:05 user devstack@n-api.service[61167]: INFO nova.api.openstack.compute.server_external_events [req-d088a90f-b759-4100-bc88-6ca91f0350d8 req-9131a037-1d7c-400f-88a3-4201d4ce715b service nova] Creating event network-vif-plugged:5304223b-a94f-43cc-b3cd-2f6f6b33ac7c for instance ae79fdab-2a0d-4dac-bcde-ac3544aca749 on user Apr 11 16:27:05 user devstack@n-api.service[61167]: INFO nova.api.openstack.requestlog [req-d088a90f-b759-4100-bc88-6ca91f0350d8 req-9131a037-1d7c-400f-88a3-4201d4ce715b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032152 Apr 11 16:27:05 user devstack@n-api.service[61167]: [pid: 61167|app: 0|req: 392/1165] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 16:27:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:27:52 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_api:SELECT=4 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:27:52 user devstack@n-api.service[61165]: DEBUG dbcounter [-] [61165] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=61165) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:27:52 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-e7a81779-ba6c-468c-9cda-d8309a9def6c tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Calling method '>' {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:27:52 user devstack@n-api.service[61165]: DEBUG nova.compute.api [None req-e7a81779-ba6c-468c-9cda-d8309a9def6c tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Fetching instance by UUID {{(pid=61165) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 16:27:52 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e7a81779-ba6c-468c-9cda-d8309a9def6c tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:27:52 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e7a81779-ba6c-468c-9cda-d8309a9def6c tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:27:52 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e7a81779-ba6c-468c-9cda-d8309a9def6c tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:27:52 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e7a81779-ba6c-468c-9cda-d8309a9def6c tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:27:52 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e7a81779-ba6c-468c-9cda-d8309a9def6c tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:27:52 user devstack@n-api.service[61165]: DEBUG oslo_concurrency.lockutils [None req-e7a81779-ba6c-468c-9cda-d8309a9def6c tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ac0a8f8b-97c7-46b7-b74b-ec39523fc1cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61165) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:27:52 user devstack@n-api.service[61165]: INFO nova.api.openstack.wsgi [None req-e7a81779-ba6c-468c-9cda-d8309a9def6c tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] HTTP exception thrown: Instance ae79fdab-2a0d-4dac-bcde-ac3544aca749 could not be found. Apr 11 16:27:52 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-e7a81779-ba6c-468c-9cda-d8309a9def6c tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Request method failure captured: Apr 11 16:27:52 user devstack@n-api.service[61165]: request: GET /compute/v2.1/servers/ae79fdab-2a0d-4dac-bcde-ac3544aca749 HTTP/1.1 Apr 11 16:27:52 user devstack@n-api.service[61165]: Accept: application/json Apr 11 16:27:52 user devstack@n-api.service[61165]: Accept-Encoding: identity Apr 11 16:27:52 user devstack@n-api.service[61165]: Connection: close Apr 11 16:27:52 user devstack@n-api.service[61165]: Content-Length: 0 Apr 11 16:27:52 user devstack@n-api.service[61165]: Content-Type: application/json Apr 11 16:27:52 user devstack@n-api.service[61165]: Host: 10.0.0.210 Apr 11 16:27:52 user devstack@n-api.service[61165]: Openstack-System-Scope: None Apr 11 16:27:52 user devstack@n-api.service[61165]: User-Agent: python-urllib3/1.26.15 Apr 11 16:27:52 user devstack@n-api.service[61165]: X-Auth-Token: gAAAAABkNYkh0ZCz0rumfim8r3VB-5v03BMYcUDF1slMX80Vu_Q1TJ95GRyYw9YsAkhlwUC5YoE6Giui1XZIrzBAZhIDL_UA5Wo95Q0-PtZLrr7Ih2IzRtTqqe2WhpZZter4_PEXjBSxNdyVD8MLDh-ffbgFh6PlcVb6osUcU36KBQn8iaUfDm8 Apr 11 16:27:52 user devstack@n-api.service[61165]: X-Domain-Id: None Apr 11 16:27:52 user devstack@n-api.service[61165]: X-Domain-Name: None Apr 11 16:27:52 user devstack@n-api.service[61165]: X-Identity-Status: Confirmed Apr 11 16:27:52 user devstack@n-api.service[61165]: X-Is-Admin-Project: True Apr 11 16:27:52 user devstack@n-api.service[61165]: X-Project-Domain-Id: default Apr 11 16:27:52 user devstack@n-api.service[61165]: X-Project-Domain-Name: Default Apr 11 16:27:52 user devstack@n-api.service[61165]: X-Project-Id: 09bb61cdc7fa4b64baf6e8ef8b1e7815 Apr 11 16:27:52 user devstack@n-api.service[61165]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1487607345 Apr 11 16:27:52 user devstack@n-api.service[61165]: X-Role: reader,member Apr 11 16:27:52 user devstack@n-api.service[61165]: X-Roles: reader,member Apr 11 16:27:52 user devstack@n-api.service[61165]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/09bb61cdc7fa4b64baf6e8ef8b1e7815"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/09bb61cdc7fa4b64baf6e8ef8b1e7815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/09bb61cdc7fa4b64baf6e8ef8b1e7815"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 16:27:52 user devstack@n-api.service[61165]: X-Tenant: tempest-VolumesSnapshotTestJSON-1487607345 Apr 11 16:27:52 user devstack@n-api.service[61165]: X-Tenant-Id: 09bb61cdc7fa4b64baf6e8ef8b1e7815 Apr 11 16:27:52 user devstack@n-api.service[61165]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1487607345 Apr 11 16:27:52 user devstack@n-api.service[61165]: X-User: tempest-VolumesSnapshotTestJSON-1487607345-project-member Apr 11 16:27:52 user devstack@n-api.service[61165]: X-User-Domain-Id: default Apr 11 16:27:52 user devstack@n-api.service[61165]: X-User-Domain-Name: Default Apr 11 16:27:52 user devstack@n-api.service[61165]: X-User-Id: 341892e1cf424bc18b4b21b261659456 Apr 11 16:27:52 user devstack@n-api.service[61165]: X-User-Name: tempest-VolumesSnapshotTestJSON-1487607345-project-member Apr 11 16:27:52 user devstack@n-api.service[61165]: method: > Apr 11 16:27:52 user devstack@n-api.service[61165]: exception: Instance ae79fdab-2a0d-4dac-bcde-ac3544aca749 could not be found. Apr 11 16:27:52 user devstack@n-api.service[61165]: action_args: {'id': 'ae79fdab-2a0d-4dac-bcde-ac3544aca749'} Apr 11 16:27:52 user devstack@n-api.service[61165]: {{(pid=61165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae79fdab-2a0d-4dac-bcde-ac3544aca749 could not be found. Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae79fdab-2a0d-4dac-bcde-ac3544aca749 could not be found. Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae79fdab-2a0d-4dac-bcde-ac3544aca749 could not be found. Apr 11 16:27:52 user devstack@n-api.service[61165]: ERROR nova.api.openstack.wsgi Apr 11 16:27:52 user devstack@n-api.service[61165]: DEBUG nova.api.openstack.wsgi [None req-e7a81779-ba6c-468c-9cda-d8309a9def6c tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Returning 404 to user: Instance ae79fdab-2a0d-4dac-bcde-ac3544aca749 could not be found. {{(pid=61165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 16:27:52 user devstack@n-api.service[61165]: INFO nova.api.openstack.requestlog [None req-e7a81779-ba6c-468c-9cda-d8309a9def6c tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae79fdab-2a0d-4dac-bcde-ac3544aca749" status: 404 len: 111 microversion: 2.1 time: 0.039112 Apr 11 16:27:52 user devstack@n-api.service[61165]: [pid: 61165|app: 0|req: 388/1166] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 16:27:52 2023] GET /compute/v2.1/servers/ae79fdab-2a0d-4dac-bcde-ac3544aca749 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0)